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Abstract 


In  this  paper  algorithms  are  presented  for  evaluating 
the  knapsack  function  for  a  class  of  two-dimensional  knapsack 
problems  such  as  arises,  for  example,  in  the  solution  of  cutting 
stock  problems  in  staged  guillotine  cutting  operations.   This 
class  includes  as  a  special  case  the  classical  one-dimensional 
knapsack  problem.   In  each  algorithm  evaluation  proceeds  from 
the  larger  knapsack  sizes  to  the  smaller,  exploiting  for  each 
size  the  optimality  of  all  partitions  or  descendents  of  an 
optimal  solution  for  a  knapsack  of  that  size.   All  of  the 
algorithms  discussed  are  based  on  the  methods  of  combinatorial 
programming  and  are  reliable  in  the  respect  that  if  carried  to 
completion  they  guarantee  optimal  evaluations  for  knapsacks 
of  each  size. 
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I.   Introduction 
In  its  simplest  form  the  knapsack  problertr  may  be 

described  as  follows.  Given  m  items  with  "sizes" 
1-,,  l2,-.-lui  ^^'^   associated  values  V2^,V2,...,v  deter- 
mine the  non-negative  integral  number  a^^  of  each  item  to 
put  in  a  knapsack  of  size  L  so  as  to  realize  a  total 
value  F(L),  where: 

F(L)  =  maximum   Z    a. v. 

i=-l    ^  ^ 

m 
Subject  to:  .Z,  a.l.   <  L 
1=1   11— 

and       a.  >^  0 ,  integer      all  i 
The  function  F(L)  has  been  termed  by  Gilmore  and 
Gomory  [8  J  the  knapsack  function. 

Besides  arising  in  contexts  wherein  an  assortment 
of  items  are  to  be  selectively  packed  into  some  form  of 
knapsack  (e.g.,  spare  parts  in  a  flyaway  kit,  cargo  in  a 
rail  car)  knapsack  problems  also  arise  in  contexts  in 
which  an  assortment  of  items  of  differing  values  are  to 
be  realized  from  a  knapsack  of  given  size,  as  in  the 
cutting  of  stock  into  rolls  or  sheets  to  match  customer 
demands.   In  some  contexts  only  a  single  dimension  of 
the  items  and  knapsack  is  relevant  for  the  problem,  as  in 
a  case  where  rolls  of  paper  of  constant  diameter  and 
given  width  are  to  be  slit  into  rolls  of  the  same  diameter 


1.   The  name  originally  ascribed  to  this  broad  class  of 
optimization  problems  by  Dant/ig  [3  ,. 
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and  smaller  widths.   In  others,  two  or  more  dimensions  must 
be  considered,  as  in  the  loading  of  cargo  subject  both  to 
weight  and  volume  limits,  the  cutting  of  stock  into  an 
assortment  of  sheets  of  different  widths  and  lengths,  or 
the  dynamic  budgeting  of  funds  over  a  number  of  time  periods . 

In  some  contexts  knapsack  problems  arise  not  only  directly 
but  indirectly  as  well,  as  for  example,  in  the  course  of 
solving  linear  programming  formulations  of  various  stock 
cutting  problems.   In  these  latter  cases  it  may  be  necessary  to 
solve  literally  hundreds  of  knapsack  problems  in  the  course  of 
solving  a  single  programming  problem.   The  efficiency  of 
algorithms  for  the  knapsack  problem  is  therefore  a  critical 
determinant  of  the  size  and  comprehensiveness  of  the  models 
which  can  be  employed  in  practice.   Although  the  results  of 
the  present  study  are  more  general  in  their  applicability 

as  will  be  apparent,  it  is  a  problem  of  this  type  which  has 

provided  the  motivation  for  the  study  and  will  provide  the 

context   for  purposes  of  discussion. 

Specifically,  the  problem  of  underlying  interest  concerns 

the  cutting  of  rectangular  sheets  of  stock  of  size  W  x  l  into 

smaller  sizes  w.xl.,  i=l,2,....m  so  as  to  fulfill  requirements 

for  r.  sheets  of  size  w.xl.,  i=l,2,...,m  at  minimum  cost. 
1  11 

Following  the  approach  suggested  by  Gilmore  and  Gomory  [l] 

the  problem  can  be  formulated  as  a  linear  programming  problem 

in  which  there  is  a  column  vector  (a  ,a^,...,a  )  corresponding 

12       m 

to  each  permissible 
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pattern  for  cutting  up  a  sheet  of  size  Wxl  ,  where  a^^  is 
the  number  of  pieces  of  size  w-j^xlj^,  i^=l,2,...m  cut  from 
a  single  sheet.   For  example,  in  Figure  2  a  pattern  is 
shown  which  yields  2  rectangles  of  size  w.xl,,  2  of 
size  W3XI3,  4  of  size  W4XI4,  3  of  size  vi-jXl-],    and  2  of 
size  wgxlq.   If  m=10  then  in  a  problem  in  which  this 
constitutes  a  permissible  cutting  pattern  there  is  a 
column  vector  (2,0,2,4,0,0,3,0,2,0)  associated  with  this 
pattern. 

In  practice  one  generates  column  vectors  only  as 
they  become  needed  during  the  solution  of  the  linear 
programming  problem^ rather  than  explicitly  generate  the 
complete  set  of  such  patterns  before  commencing  to  solve 
the  problem.  This  is  accomplished  by  solving  at  each  iteration 
a  knapsack  problem  of  the  form: 

F(W,L)  =  maximum   Z   a .  ^^^ 

i^l 

(^l'^2'  •  -'^m' 

Subject  to  the  condition  that 
(aj^,  a_  ,  .  .  .  ,aj^)  correspond  to  a 

permissible  pattern  for 
cutting  up  a  sheet  of  size  Wxl  . 

where  'if-     is  the  value  of  the  dual  variable  associated  with 

requirement  r^   at  the  present  iteration  and  F(Vn;,I-)  is  the 

2  ^ 

maximum  value  realizeable  from  a  rectangle  of  si.ie  V7xT  . 

2.  In  some  instances  the  orientation  of  a  required  rectangle 
Wj^>:l-L  with  respect  to  the  sheet  Wxl  is  irrelevant;  m  such 
cases  it  is  sufficient  for  knapsack-problem  purposes  to 
simply  include  among  the  original  requirements  a  rectangle 
of  width  lj_  and  length  w-l  having  the  same  value  Vj^  . 
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In  the  present  case  the  cutting  patterns  to  be  deemed 
permissible  are  those  which,  in  the  terminology  of  Gilmore 
and  Gomory  [7],  can  be  obtained  through  staged  guillotine 
cutting.   By  a  guillotine  cut  is  meant  one  in  which  the  cut 
begins  at  one  side  of  the  rectangle  and  traverses  the  stock 
in  a  straight  line  to  the  opposite  side.   By  k-stage  guillotine 
cutting  is  meant  cutting  which  takes  place  in  k  distinct  stages, 
each  stage   in  which  cutting  takes  place  lengthwise  alternating 
with  a  stage  in  which  cutting  takes  place  widthwise.   For 
example.  Figure  1  illustrates  a  pattern  which  can  be  cut  in 
two  stages:   in  the  first  stage  the  sheet  is  slit  lengthwise 
into  three  strips  (plus  edge  trim)  and  in  the  second  each  of 
the  strips  is  chopped  individually  across  its  v/idth  to  pro- 
duce the  desired  sizes. 


rvT 
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Figure  1.   Pattern  obtained  with  exact, 
2-stage  guillotine  cutting. 
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In  some  instances  a  triituning  stage  is  permitted  after 
the  completion  of  the  k    stage,  at  which  time  the  resulting 
rectangles  may  be  trimmed  on  one  side  to  yield  the  required 
size.   This  is  termed  the  inexact  case  to  distinguish  it  from 
the  exact  case  in  which  all  rectangles  resulting  at  the  com- 
pletion of  the  k^^  stage  must  comply  exactly  with  the 
dimensions  of  the  requirements  without  further  cutting  opera- 
tions.  Figure  2  shows  a  pattern  which  can  be  produced  with 
3-stage,  inexact  guillotine  cutting;  the  pattern  in  Figure  1, 
on  the  other  hand,  is  realizeable  by  exact  cutting. 
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Figure  2.   Pattern  obtained  with  inexact,  3-stage 
guillotine  cutting. 

In  solving  the  knapsack  problem  that  results  for  k-stage 

guillotine  cutting,  problem-solving  efficiency  is  determined 

by  the  efficiency  of  algorithms  employed  for  solving  several 

simpler  forms  of  knapsack  problems.   The  simplest  arises 
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in  single-stage  cutting  when  a  strip  of  stock  of  length  L, 
say,  is  to  be  chopped  up  into  a^  pieces  of  length 
1^,  i=l,2,...,m  so  as  to  maximize  the  value  F{L).   This  is 
the  basic  one-dimensional  knapsack  problem  stated  in  the 
opening  paragraph  for  which  a  number  of  dynamic  programming 
algorithms  [2,5,7,8,14]  and  combinatorial  programming  al- 
gorithms [6,12]  are  available. 3 

In  the  case  of  2-stage  guillotine  cutting  an  optimal 
pattern  can  be  determined  by  solving  the  required  knapsack 
problem  in  two  steps.   The  first  requires  the  evaluation  of 
an  optimal  cutting  policy  for  chopping  up  a  strip  of  any 
width  wj^  (and  length  L)  which  may  result  from  cutting  at  the 
first  stage;  the  second  step  requires  the  determination  of 
an  optimal  plan  for  cutting  strips  at  the  first  stage.   That 


IS; 


(i)   For  all  widths  wi_  determine  ?.:  ,  the  optimal 
value  F(L)  obtainable  by  fitting  rectangles 
Wjxlj  end  to  end  into  a  strip  of  width  Wj_ 
and  length  L,  where  Wj  <^  w^    in  the  inexact  case, 
and  Wj-Wj^  in  the  exact  case.   For  each  i  this 
is  a  basic  one-dimensional  knapsack  problem. 


(ii)  Determine  an  optimal  solution  to  the 

basic  one-dimensional  knapsack  problem 
with  F(W)=max  Z  ^x^^,    subject  to  the 

constraint  Z  a^Wj^  <  W 


3.  For  the  special  case  in  which  aj_=0,l  for  all  i^  see  refer- 
ences [  4] .  [10]  and  [ll]. 
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When  there  are  m  different  requirement  widths  Wj^  solution 
of  the  knapsack  problem  for  2-stage  guillotine  cutting 
implies  the  solution  ol  (ra  +  1)  knapsack  problems  of  the  basic 
one-dimensional  type.   In  practice  this  can  actually  be 
accomplished  in  two  knapsack  calculations  by  using  the 
dynamic  programming  algorithm  in  reference  [7]  since,  by 
ordering  the  widths  so  that  w,  <  W2  <  . . .  <  w  ,  this 
algorithm  evaluates  successively  F-|(L),  F2  (L)  ,  .  .  . ,  Fjj^(L)  in 
the  process  of  determining  F  (L) ,  where  FgCL)  is  the  optimal 
value  of  a  knapsack  of  size  L  using  only  the  first  s  lengths, 

1  ,  1  ...,1  ,   Alternately,  the  problem  can  be  solved  by  a 
12      s 

combinatorial  programming  algorithm  [isj  . 

For  3-stage  cutting; similarly,  an  optimal  pattern  can  be 

determined  by  solving  the  required  knapsack  problem  in  three 

steps.   The  first  step  now  involves  the  determination  of  an 

optimal  policy  for  cutting  at  the  third  stage  any  sheet  which 

might  result  as  a  consequence  of  cutting  at  the  second  stage. 

This  requires  the  evaluation  of  the  knapsack  function  F(y ,x) 

for  all  y,  0  <  y  <  W  and  for  each  strip  length  x=l^  for 

which  there  is  a  requirement  w^xl^  at  the  present  (third) 

4 
stage.   Upon  evaluation  the  set  of   nondominated   rectangle 


4.   We  will  say  that  size  x_x  y  dominates  size  x  x  y  if 
X  <  X ,  y  <  y  and  F  (y  ,  X )  >  F  (y ,  X)  . 


-8- 


sizes  X  X  y  which  result  form  the  requirements  for  a  2-stage 
problem  (stages  1  and  2)  which  remains,  this  problem  being 
solved  in  two  st^»  as  described  in  the  preceding  paragraph. 
Similarly,  in  k-stage  guillotine  cutting  solution  of  the 
knapsack  problem  begins  at  stage  k  and  proceeds  step  by  step 
through  stages  k-1,  k-2,...2,  each  step  employing  as  the 
appropriate  requirements  sizes  w-xl.  the  non-dominated  sizes 
X  X  y  determined  at  the  previous  step,  the  procedure  cul- 
minating with  the  solution  of  the  2-stage  knapsack  problem. 

In  practice^  in  k-stage  cutting  the  number  of  requirements 
and/or  the  number  of  stages  feasibly  considered  is  severely  limited 
computationally  by  the  time  expended  in  evaluating  the  knapsack 
function  F(y,x),  0  <  y  <^  W,  x=lj_,  i^l,2,...,m.   One  possibility, 
presently,  is  to  employ  the  dynamic  programming  algorithm  of 
reference  [7]  which,  upon  ordering  the  lengths  so  that 
1]^  <_  I2  <  •  •  •  ^  1_,  evaluates  in  the  single  computation  for 
F(lj^^,  W)  all  of  the  desired  values  of  F(y,x)  .   Another  possi- 
bility is  to  employ  for  each  1-  independently  an  efficient 
dynamic  programming  algorithm  such  as  Gilmore  and  Goraory's 
algorithm  l.B  in  reference  [7j  to  evaluate  F(1^,W)  which  m  the 
evaluation  also  yields  the  values  F(y,  1^) ,  0  <  y  <  w.   The 
choice  between  these  alternatives  depends  on  the  number  of 
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5 
different  sizes  m  being  considered.    At  present  computational 

feasibility  appears  to  be  questionable  even  for  3-stage  cutting 

in  problems  having  a  moderate  number  of  requirement  sizes. 

An  alternative  to  these  approaches  to  be  considered 

in  this  report  is  to  develop  algorithms  based  on  combinatorial 

programming  rather  than  on  dynamic  programming  considerations 

for  evaluating  the  function  F(y,x)  at  each  stage  k  >  2,  an 

alternative  suggested  by  results  to  date  indicating  that  for 

both  the  one-stage  and  the  two-stage  knapsack  problem  there  is 

an  algorithm  of  the  former  type  which  is  generally  faster 

5 
than  those  reported  of  the  latter  type.    In  the  following 

sections  we  consider  first  the  basic  one-dimensional  problem 
(1);  in  Section  II  we  present  the  underlying  theory  and  ideas 
to  be  used  and  in  Sections  III  and  IV  two  different  algorithms 
for  evaluating  the  knapsack  function.   Then  in  Section  V 
the  results  of  Section  II  are  neneralized  for  the  two- 
dimensional  knapsack  problem  arising  at  stage  k  and  algorithms 
discussed  for  evaluating  the  knapsa>_k  function. 


5.   The  results  of  a  comparative  study  of  knapsack  algorithms 
will  be  presented  in  a  subsequent  report. 
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II.   Underlying  Theory  and  Ideas 

Throughout  this  section  the  problem  to  be  considered  is  the 
basic  one-dimensional  problem  stated  earlier:   given  m  items 


with  'lengths"  l,,l^,.,..l   and  values  v,,v„ 
^       1   2     '  m  1'  2 


F(L)  =  maximum 


m 

.2,  V . a. 
1=1   1  1 


^'^2' 


m 


m 


Subject  to:  .E,  a   1.  <  L 
1=1   i   1  ^ 


,v  ,  determine: 
m 


(1) 


and   a.  >  o,  integer 


all  i 


for  all  L,  o  <  L  <  L 


max 


To  facilitate  discussion  a  solution 


(a  ,a  , ...,a  )  will  commonly  be  denoted  by  A,  its  length 

Z  l.a.  by  L(A),  and  its  value  Z  v.a.  by  V(A). 
ill-'-'  ill-''' 

To  begin  we  note  that  germane  to  all  of  the  algorithms 
that  will  be  discussed  in  this  paper  is  the  fact  that  from 

an  optimal  solution  A   =  (a,,  a^,  ...,  a  )  for  length  L  one  can 

■~o      12        m 

">    o 
derive  immediately  an  optimal  solution  for  each  of  itsT]_  (a.+l)  -2 

partitions  or  descendents.   Or,  to  state  it  more  precisely: 

Theorem   1:   If  A   =  (a°   a°   . . . , a°)  is  an  optimal  solution 

— o      12       m 

to  (1)  with  value  F(L) ,  then  A'  = 

(a'   a',..., a')  is  an  optimal  solution  to  (1) 
12      m 

with  value  F(L'),  for  each  A'  such  that 

— o 

m 


a!  <  a.,  i=l,2, ,m,  where  L'  =  Z    l.a'.. 

1     1  i=i   1  1 


6.   This  same  result  has  been  derived  earlier  by  Shapiro  and 
Wagner  [14]  who  have  considered  also  a  class  of  multi- 
dimensional knapsack  problems  and  a  distribution-of- 
effort  problem. 
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To  prove  the  theorem  we  suppose  that  for  some  descendent  A'  there 

— o 

exists  a  solution  A  with  length  S  l.a.  <  Z    l.a!  and  value 

i       1    1    -    .        1    X 

£  v.a.    >   Z   v.a! .      But   then   there   exists   a   solution 
111         ill 

O  /\ 

A*,a*^a. -a! +a . ,    i=l,2,...,m,    with    length   Y    l.a*   <    L    and   value 
-1111  111   — 

Z  v.a*  >  F(L) ,  contrary  to  the  assumption  that  A   is  an  optimal 

solution  for  length  L.   Hence  there  can  exist  no  solution  ^ 

better  than  A' ,  for  any  descendent  A' . 
— o        -'  — o 

As  an  illustration  of  Theorem  1,  suppose  that  an  optimal 

7 
solution  for  length  L=ll  has  been  obtained  m  the  sample  problem 

of  Appendix  A.   Then  if  this  optimal  solution  is,  say,  A.  as  shown 

in  Table  A.l,  we  have  at  once  the  optimal  solutions  A_ ,  A.  _,,  A.,  ,  , 

~D    10    11 

A   ,A   ,  and  A   and  hence  the  values  F(9)=8,  F(8)^7,  F(6)=6, 

F(5)=3,  F(3)-2  and  F(2)=l. 

Theorem  1  immediately  suggests  the  evaluation  of  F(L)  by 

starting  with  L    and  proceeding  in  an  order   L   >  L,  >  L^>...>0 
max     '^  max    1     2 

That  is,  we  begin  by  solving  (1)  with  L-L     to  get  A  .   After 

recording  F{L    )=V(A-)  in  Table  A. 3  all  descendents  Al  of  A   are 
max     -HD  — 0     — o 

generated  and  L ' -Zl .  a .  andV'=Zl.a'.  evaluated  for  each,  and  the 
0    1  1      0    1  1 

values  F(L')=V'  recorded.   We  then  determine  the  largest  value  L 

7.    For  illustration  the  data  for  a  problem  with  four  lengths  is 
detailed  in  Appendix  A.   In  Table  A.l  are  listed  the  44  pos- 
sible feasible  solutions  A.  arrayed  in  lexicographically 
decreasing  order,  where  A^  is  lexicographically  smaller  than 
A   if  a?-a^,  aS^as, - . . , a|_]  =^r_l>  ^nd  a|  >  a^    for  some  r, 
o  <  r  <  m.   In  Table  A. 2  these  same  solutions  are  re-ordered 
by  length,  L^  =  Zlj_a-) ,  hnd   arranged  in  lexicographically 
decreasing  order  within  length.   Table  A. 3  gives  the  function 
F{L),  and  finally,  Table  A. 4  gives  a  non-dominated  schedule 
of  solutions  A   from  which  all  values  of  F(L)  can  be  realized. 
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for  which  F(L)  has  not  been  evaluated  and  solve  the  knapsack 
problem  (1)  for  L=L,  getting  an  optimal  solution  A  .   As  before. 


/\ 


we  record  F(L)=V(A  ),  generate  all  descendents  A[    of  A.  and  record 

i  —1    —1 

the  values  F(L')  .   Continuing  in  this  manner  we  finally  reach 

L=0  at  which  time  we  conclude  by  deriving  from  the  table  F(L)  a 

schedule  of  dominating  solutions  by  eliminating  all  entries  k 

for  which  there  exists  an  entry  j  such  that  L  >  L .  and 

'^    J 

F(L  )  -  F{L.)  . 
^        J 

Within  this  general  framework  there  are  a  number  of 
alternatives  and  considerations  which  arise.   We  consider  first 
some  further  possibilities  for  reducing  the  number  of  values  L 
that  need  be  evaluated  by  explicitly  solving  knapsack  problem  (1) , 

To  begin  it  is  noted  that  while  F(L)  is  defined  for  all 

0  <  L  <  L      it  can  change  value  for  only  a  finite  number  of 
"~  max  ■' 

values  of  L.   For  exact  evaluation  of  F(L)  it  is  sufficient,  for 

example,  to  evaluate  the  lengths  L=6 , 26, . . . ,k6 ,  where  k  is  the 

largest  integer  such  that  k6  <  L    and  where  6  can  be  taken  to  be 

—  max 

the  value  of  the  largest  factor  b  which  is  common  to  each  of  the 

values  1,,  1^,...,1  ,  since  all  lengths  Z  ,  l.a.  must  necessarily 
12m  x=l   11 

be  a  multiple  of  b.   In  our  example,  for  instance,  b=l  so  that  in 

such  a  case  all  integer  values  of  L  would  be  considered. 

Alternately,  a  more  course  grid  might  be  used.   For  instance,  if  a 

precision  of  F(L)  +A  F  were  acceptable  for  every  L  then  any  5  up 

to  the  value  (AF)/   [max  (v./l  )]   would  be  satisfactory.   In  any 

case,  however,  we  may  set  F(L)=0  for  all  L  <  min(l.) . 

i 
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Hence  in  evaluating  F(L)  (exactly)  only  values  'l  >  inin(l.)  and 
divisible  by  6  need  be  evaluated,  and  for  some  of  these  values 
F(L)  can  be  evaluated  directly  from  other  solutions  without  neces- 
sitating the  solving  of  a  separate  knapsack  problem  as  a  consequence 
of  Theorem  1.   Fortunately,  there  may  be  additional  lengths  L  which 
can  be  evaluated  without  explicitly  solving  a  knapsack  problem  for 
length  L.   For  example,  suppose  that  problem  (1)  has  been  solved 

for  a  length  L  and  an  optimal  solution  A*  obtained  having  value 

m         _ 

V*(L) .  If  L*=.Z,  l.a.  <  L  then  A*  constitutes  ^n  optimal  solution 
1=1   11— 

for  all  L,  L*  <^  L  <  L.   This  fact  while  quite  apparent"  can  be  very 
significant  in  reducing  total  problem-solving  effort.   To  facili- 
tate future  reference  we  state  it  in  theorem  form: 
Theorem  2:  If  A*  is  an  optimal  knapsack  solution  to  problem  (1) 

with  constraint  T.l.a.  <  L  having  value  V  and  length 

11  — 

L*=  yi.a*.  then  A*  is  an  optimal  solution  to  all 
11       — 

problems  with  constraint  Zl.a  <  L  for  L*  <  L  <  C. 

1  i  -  -   - 

Thus  in  solving  the  one  knapsack  problem  with  length  C  we  obtain 

the  evaluation  of  all  points  L*  ^  L  <  L  together  with  those 

associated  with  each  descendent  of  A*. 

In  addition  to  these  possibilities  it  is  also  possible  to 

determine  directly  the  value  of  F(L)  for  some  L: 

Theorem  3:   Let  the   m   items  be  ordered  so  that  ({),  >(i)^^  ...>(I)  , 

1   —      ?   —  —  ^m 

where  (t).-v./l  •   Then  solution  A*  =  (a* ,  a* .  0  ,  ..  0)  and 
111  —       12' 


8.   Since  if  there  were  a  solution  yielding  V(L)  >  V* (f)  then  A* 
could  not  be  optimal  for  L. 
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all  of  its  descendents  are  optimal  for  length 

9 
L*  =  SI. a*,  where    a*  =  <1-/1^  -  a>,  o-*0. 
■L  1  1  2      12 

To  prove  that  A*  is  optimal,  suppose  the  contrary.   Suppose  there 

exists  a  solution  A  with  SI. a.  <  SI. a*  and  V=  Sv . 3 .  >  V*  =  Sv . a* . 

—      ill  —  ill        ill  11 

Since  l^at  <  l-ij^?  =  <L*/1  >  so  that  necessarily  a  ^  ^'^  •      Suppose 

a,  =  a*.   Then  an  upper  bound  on  V  is  V   =  v  a*  +  ({)^(l^a*)  .   But 
11  ^'^  llf222 


since  this  bound  is  attained  by  A*,  there  exists  no  S  with  a  =a* . 
Suppose,  then,  that  a,=a?  -  t>,  b  >  0.   Then  an  upper  bound  on  V 
is  v^(a*  -  b)  +  C})^  (l^b  +  l^a*)  =  v^a*  +  v^a*  +  {(J)^-*})^)  •  (l^^b)  which 
cannot  exceed  V*  since  (|)   <  (t^,  .   Therefore  A*  is  optimal  for 
length  L* .   And  finally,  the  descendents  of  A*  are  optimal  as  a 
direct  consequence  of  Theorem  1. 

Referring  again  to  the  problem  in  Appendix  A  for  illustration, 
it  is  seen  that  all  lengths  are  ordered  so  that  0   >  ^'-^  >  'l)^  >  0>,> 
Therefore  a*  =  <1  /I  -a>  =  <6/3  -  a>  =1.   All  feasible  descendents 
of  A  =  (2,1,0,0)  must  therefore  be  optimal:   (2,0,0,0),  (1,1,0,0), 
(1,0,0,0)  and  (0,1,0,0).   We  thus  have  immediately  the  optimal 
values  F(12)  -  12,  F(9)  =  8,  F(6)  =  6  and  F(3)  =  2. 

While  highly  desirable  to  extend  Theorem  3  to  other  cases 
which  can  be  evaluated  directly,  extension  appears  to  lead  to 
rather  specialized  results  which  are  cumbersome  to  implement. 
Theorem  4  represents  one  such  extension: 

9.    We  will  denote  by  <g>  the  largest  integer  contained  in  g. 
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Theorem  4:  Let  the  lengths  be  ordered  so  that  6,  >  (p_  >  .  .  .>  6  , 

1     2  ~     —   m 

where  i) .    =  v. /I-   If  1  .  ,   >  1.  for  all  i,  2  <  i  <  s, 
1     11       j-1      J         ->'—-'—' 

then  A^  =  (a*,  a*,  ...,  a*,  0,...,0)  and  all  of  its 
^      12         s 

descendents  are  optimal,  where  a*  <  <(1.   )/l.> 

1=^2,  ...,  s-1,  and  a*  rain  [<(1   ,  ) /I  >,  b  1 ,  and  where 

s         s-1    s     s  ' 

b   satisfies  the  following  set  of  (s-2)  inequalities: 

(C)  -6    )-l   >  (6    -6    )  a*   1     +  (d)    -6    )» 
^^j  'j  +  l'   j  -    j  +  1   j+2^  j+2  j  +  2    ^j  +  1   j  +  3' 

a*  ^1.  ^+...(0.   -6    )    a*   1   ^  +  ((t).   -(!)  )  b  1 
j+3  j+3       J+1   s-1    s-1  s-1     'J+1  s         s  s 

for  all  j,  i<.j  <s  -  2. 

To  prove  Theorem  4  we  proceed  as  in  the  previous  theorem.   Suppose 

there  exists  a  solution  ?.  with  value  V  >  V* .   Suppose  a .  -  a*  for 

—  11 

i  =  1,2,..., s-1.   Then  an  upper  bound  on  V  is  V   =  v*  -  (a*  -a  ) v   + 

s   s   s 

0  , (a*-a  )1  .   But  since  V  <  V* ,  A  cannot  have  a  value  exceeding 
s  fl   s   s   s  —    •  —  ^ 

that  of  A*.   Therefore,  suppose  a.=a*  for  i=l , 2 , . . . , s-2:  then 
-U      ~      -  "^^      1   1 

V  -V*  -  ((a*  -  a  )v   +  a*   V   ,)+({)   ,  [  (a*-a  )  1  +(a*   1   J  ]  = 
s     s   s     s-1  s-1     ^s-1    s   s   s    s-1  s-1 

V*  -  (0  -O   J -(a*  -  a  )1   <  V*.  since  0   >  (J   ,.   Thirdly,  suppose 
ss-1     s     ss—  s— s-1 

a   ^=a*  ^-d;  then  V  -V*  -  [dv   ^  +  a*   v   ,  +  a*v  ]  +  t         • [dl   ^+ 
s-2   s-2  s-2     s-1  s-1     s  s     ^s-1     s-2 

a*   1   ,  +  a*l  ].   For  V*  >  v"  we  then  must  have,  for  0  C  d  <  a*  ^, 
s-1  s-1     s  s  —  —   —   s-2 

d0    1   .  ^  a*   6   -1   -  +  a*6  1      >  dO   ,0    1   ^  + 
S-2S-2     s-ls-l--!     sss     —    s-ls-ls-2 

a*    <{)    1     +  d)    a*  ,     • 

s-l'^s-l  s-1    ^s-1  s-1      or  d(0   ^-0   Jl   ^  >  (t)   ,  -  (?  )  a*  1  . 

s  s-2   s-1   s-2  —    s-1    ^s    s  s 

Since  this  inequality  holds  for  all  0  <  d  ~;  a*     when  it 

holds  for  d-1,  we  have  simply  the  one  condition,  ((t)   ^-(t)   J  . 

s-2s-] 

1  ^   >    (i)      ,-6  )a*l  .   When  this  inequality  holds,  v"  <    V*. 
s-2  —   ^s-1  ^s   s  s  n      J       ... 
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Similarly  we  consider  in  turn  a.  <  a*,  i  =  s-3,  3-4 1:   in 

each  case  an  additional  inequality  of  the  same  form  results  which 

must  be  satisfied  to  insure  V^  <  V* .   The  result  is  thus  the 

(s-2)  inequalities  as  stated. 

As  indicated,  this  result  would  appear  rather  cumbersome  to 

employ.     On  the  other  hand,  the  potential  savings  in  total 

problem-solving  time  accruing  through  its  use  might  be  quite 

significant  in  particular  problems.   While  Theorem  4  is  not  directly 

applicable  to  the  sample  problem  in  Appendix  A  since  1^  >  1~,    let 

us  assume  for  illustration  that  1  were  not  in  the  problem.   We  then 

have  1   >  1   >  1   so  that  Theorem  4  with  s  =  3  is  applicable.   From 

the  theorem  we  get  the  inequality 

{(t)   -()))'l   >(())   -(i))bl 
^^1    ^2'       1  -  ^^2    ^4^   4  4 

°^    ^4  <  ("^1  -  ^2)  ^1  ^  (1    -  2/3)  6  _  (1/3)  (6)  ^      2      ^    f^ 
^^    -    ^^)     1^    (2/3  -  1/2)  2    (1/6)  (2)    1/3 

Therefore  a*  <  min  [<1  /I  >,6]  -  min  (1,6)  =  1,  so  that  A*  =  (2,1,0,1) 

and  all  solutions  (2,0,0,0),  (1,1,0,1),  (1,1,0,0)  (1,0,0,1),  (1,0,0,0) 

(0,1,0,1),  (0,1,0,0),  and  (0,0,0,1)  are  optimal.   This  yields  the 

values  F(12)  -  12,  F(ll)  =  9,  F(9)  =  8,  F(8)  =  7,  F(6)  =  6, 

F(5)  =  3,  F(3)  =  2,  and  F(2)  =  1. 

As  an  aside,  reference  to  Table  A. 3  shows  that  these  values 

are  in  fact  the  optimal  values  for  the  illustrative  problem 

10.   Some  simplification  is  possible  at  the  expense  of  the  range 

of  a*  by  making  use  of  the  fact  that  for  every  j,  l.a*  ♦ 

^  1.  ^.a*,^  +  .  .  .  +  1  a*  <  1  .  ,  .  ^  ^ 

j+1  j+1  s  s     j-1 
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consisting  of  all  four  lengths  including  1^.   This  follows  from 

the  fact  that  1   can  indeed  be  eliminated  from  the  problem  since 

it  is  dominated  by  1^  and  1^-.  1^  +  1^  =  1^  and  v^  +  v^  >  v^  . 

^2       42     4     5       2     45 

Were  this  to  be  recognized  at  the  outset  1   could  be  eliminated, 
thus  making  applicable  Theorem  4  rather  than  the  weaker  Theorem  3. 
On  the  other  hand,  of  course,  discovery  of  facts  of  this  nature 
is  time-consuming.   We  will  refer  again  to  this  point  later. 

With  these  possibilities  of  determining  directly  the  value  of 
F(L,)  for  some  values  of  L,  we  return  now  to  possibilities  for 
inferring  the  optimal  value  of  other  points  from  bounding  con- 
siderations.  Theorem  2  provided  the  simplest  and  most  direct 
result  of  a  bounding  nature  but  the  possibilities  are  much  more 
general,  of  course.   We  summarize  them  in  theorem  form  for  subse- 
quent reference: 

Theorem  5: If  U(I)  is  any  valid  upper  bound  on  the  value  of  F(L) 
and  B(L)  is  any  valid  lower  bound,  then  B(L)  <  F(L) 
<  U(L)  .   If  B(L)  =  U(I,)  then  F(L)  =  B(L)  and  any 
solution  A*  optimal  for  I*  <  L  yielding  value  V*  =  B(L) 
is  optimal  for  length  I . 
To  develop  specific  bounds  for  use  with  Theorem  5  we  note 
first  two  theorems -'■-'■  employed  by  Gilmore  and  Gomory  [8]. 

Theorem  6:   Let  the  lengths  1.  be  ordered  so  that  (j),  >({)„>  .  •  .>  (j)  , 

^      1  1— ^2— —  ^m 

11.   Theorems  5  and  6  in  reference  [8|,  p.  1054. 
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and  let  F.  .   .  (L)  denote  the  maximum  value  of  (1) 

attainable  for  L  using  only  lengths  1.,  1.  ,,..., 1,  . 

J    J  +  1      k 

Then  for  any  L  there  exists  for  each  r,  1  <  r  <  m, 
a  length  L   such  that 

F(L)  =  F^^^2^   (L^)  +  F^^^^^^^a^) 

for  some  L   <  L   and  L   ^-  L   <  L. 

As  they  have  shown  the  theorem  is  satisfied  by  the  value 

L^==l    d   ,+1   ^d   ^+...+ld,  where  lb   =  1  .d  .  for  each 
0     r+1  r+1     r+2  r+2  mm'         r  r     j  j 

j  >  r,  for  any  positive  integers  b   and  d.,  although  they  have 

found  that  for  any  r,L   is  generally  much  smaller  than  this 

value    in  practice. 

In  particular.  Theorem  6  holds  for  r  =  1:   there  exists  an 

L   such  that  for  all  L  >  L_  ,  F(L)  =  <(L-L„)/l->  v  +F    „x  (L.)  . 
U  U  211(2,  m)    2 

Therefore,  for  L  >  L  ,F(L)  =  F(L-1  )  +  v  .   Defining  f(L)=F(L)- 

<L/1  >v  ,  the  following  important  result  is  obtained: 

Theorem  7:   There  exists  a  length  L   such  that  for  all  L  >  L  , 

f (1)  =  f (L-1  ) ;  that  is,  f (L)  is  periodic  of  period  1  . 
1  1 


That 


is,  if  we  define  g  (y)  =  F(nl,+y)  -  nv-  for  all  y,  0  <  y  <  1, 

n  1  i  L 


then  for  all  n  such  that  nl,  >  L- ,  g  (y)  =  g(y)  for  all  y.   There- 

1  ~  0    n 

fore  once  g(y)  is  determined  F(L)  becomes  known  for  all  L=nl  +y  >  L  . 

12.   A  somewhat  lower  value  L*  for  L   follows  from  the  fact  that  the 

value  of  a-  for  each  i     may  be  limited  to  a.  <  d.-l  in  an 

J  i  —   1 

optimal     solution  so  that  L*=l   , (d   ,-l)+...+l  ^d  -l)+e 
^  _ra     ,  ^  0   r+1   r+1         mm 

=L--CS.     l.hf-e,€-^o- 
0   j=r+l  J 
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For  L  <  I    Theorem  7  of  course  does  not  apply.   However,  it 

may  be  possible  to  infer  values  F(L)  for  particular  lengths  L  by 

employing  Theorem  5  m  conjunction  with  the  following: 

Theorem  8:   For  all  n  >  0  ^nd  all  y,  0  <  y  <  1  ,  g  (y)  < 

g  ^^(y) .   For  all  y^  and  y^,  0  <  y^  <  y^  <  1^, 

g„  (yj  <  g„  (y,)  • 

n    1      n         Z 
The  proof  follows  in  each  case  upon  substituting  g  (y)=  F(nl  +y)  - 

F(nlJ  for  g  (y)  ,   In  the  first  case,  g  (y)  <  g  ,  ,  (y)  if  and  only 

In  n     ~   n+i 

if  F{nl  +y)  -  F(nl  )<  F(  (n+1)-  1^+y)  -  F({n+1)  1^),  or,  if  and  only  if 

F(  (n+1)  1   +  y)  >  F(nl  +y)  +  v  .   But  if  A  =  ^^i' ^2  * ' * ' ^m^  ^^  ^" 
optimal  solution  for  length  L=nl  +y  then  A'  =  (a  +1, a  , . . . , a  )  is 
feasible  for  length  L-(n+l)l  +y   and  has  value  F(nl  +y)  +  v  ; 
therefore  an  optimal  solution  must  have  a  value  at  least  as  large, 

and  hence  F((n+l)l,+y)  >  F{nl,+y)+v  .   That  g  (yj<  g  (y^)  for  all 

i~  1  1  nl'~n2 

0   <   y     <   y^   <    1,     follows   directly    from   the    fact   that   F(nl   +/    )    < 

F(nl^    +    y^) . 

If  we  now  denote  by  g  (y)  and  g  (y)  an  upper  and  lower  bound 

n  n 

respectively  on  g  (y) ,  it  follows  from  the  theorem  that 

n 

9^  (y)==  max      ^^s^^'^  ^  ^^^ 

0  <  X  <  y 

0  <  s  <  n 

and 

g^(y)=  rain     [{g3(x)  )  ,  ^^y]  (3) 

X  >^  y 

s  ^  n 
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Therefore  upon  using  Theorem  5  for  L  =  nl   +  y. 

B(L)  s  nv  +g^(y)  <  F(L)  <  nv   +  g"(y)  =  U(L)     (4) 
In  in 

so  that,  in  particular  F(L)  becomes  known  for  all  L  such  that 

g  (y)  -  9    (y) •   Thus  in  the  example,  for  instance,  we  conclude 
n       n 

since  F(13)  =  F(12)  =  12  that  g"(l)  =0  for  n  <  2  and  therefore 

n 

that  F(nl  +1)  =  F(nl  )  for  n=0,l,2:  F(7)=F(6)  =6  and  F(1)=F(0)=0. 
Finally  it  is  noted  that  during  the  generation  and  evaluation 

A 

of  descendents  it  may  be  possible  to  identify  additional  values  L 

that  can  be  evaluated  directly.   These  possibilities  are 

extensions  of  a  descendent,  where  an  extension  of  a  solution  A  is 

defined  to  be  any  vector  A"  for  which  a."  >  a.   for  all  i=l,2,...,ra. 

—  1  —  1 

Theorem  9:   Let  A  be  an  optimal  solution  with  value  F(L)  and 
let  A'  be  any  descendent  of  A.   If  F(L' ) =F{L' -d) , 
for  any  d  >  o,  then  F(L")  -  F(L"-1)  =  ...  =  F(L"-d) 
for  every  solution  A"  which  is  both  an  extension  of 
A'  and  a  descendent  of  A.   If  A*  is  an  optimal  solu- 
tion for  length  (L'-d)  then  (A*4-A"-A')  is  an  optimal 
solution  for  length  L",  L"-l,  .  .  .J^"-d. 

The  proof  follows  from  the  fact  that  an  upper  bound  on  F(l."-d)  is 

U(L"-d)  =  F(L")  =  F(L')  +  S  V.  (a."  -  a.'),  or  since  F(L' ) =F(l ' -d) , 

j_   1    1      1 


U{L"-d)  =  F(L'  -d)  f-  1  V.  (a.  "-a.  •)  ,  wnere  L"=L'  +  2  1.  (a.  "  -  a.  '  )  . 
But  the  solution  (A*  ^  A"  -  A')  attains  this  bound  and  is  feasible 
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for  length  (L"-d)  since  L*  <  L'-d;  hence  (A*+A"-A')  is  an  optimal 
solution  for  length  (L"-d) .   Similarly  by  Theorem  2  it  must  also 
be  optimal  for  L",  L"-l, . . . ,L"-d+l . 

Incorporating  these  considerations  into  the  general  evaluation 

procedure  sketched  earlier  there  emerges  a  procedure  for  evaluating 

F(L) .  0  <  L  <  L    ,  something  as  follows.   First  a  value  of  the 
'    —   —  max' 

decrement  6  is  selected  and  F{L)  set  to  zero  for  all  L  <  min(l.) . 

i 

Then  Theorem  3  and/or  Theorem  4  is  employed  to  determine  directly 

one  or  more  parent  solutions  A^ .   Each  parent  together  with  its 

descendents  are  then  generated  and  evaluated  to  give  an  initial  set 

of  entries  F(L) .   Next,  the  length  L*  beyond  which  f (L)  is  periodic 

A 

is  evaluated.   For  the  largest  unevaluated  length  L  <  L     the  values 

of  g  (y)  and  g  (y)  for  nl,  +  y  =  L  are  determined.   If  g  (y)=  g  (y) then 
^  n  n  1  n       n 

F(L)=nv   +  g  (y) ,  in  which  case  the  process  simply  proceeds  to  the 
1     n 

next  smaller  unevaluated  length  L.   When  a  length  L  is  encountered 
for  which  the  bounds  are  not  equal,  a  knapsack  problem  is  solved 
for  length  L  to  determine  an  optimal  solution  A^ .   Upon  setting 
F(L)  =  V*  for  all  L*  <  L  ^  L,  the  descendents  A^  of  A^  not  previ- 
ously obtained  are  generated  and  evaluated,  and  the  results 
recorded  in  the  table.   All  of  the  newly  evaluated  points  F(L)  in 

the  table  are  now  used  to  update  bounds  g  (y)  and  g  (y)  for  all 

r-  ^n         n 

relevant  n  ancl  y.   The  process  then  continues  with  th3  next 
smaller  unevaluated  L,  eventually  terminatiig  when  all  L  have  been 
evaluated . 

Referring  once  again  to  the  example  in  Appendix  A,  we  begin 
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by  selecting  S^l,  setting  F(0)-F(l)-0  and  computing  L*  =  1  (2-1) 
+  1  (6-1)  +  1  (3-1)  =  3  +  25  +  4  -  32.   Since  L*  >  13  it  is  therefore 
not  possible  to  exploit  the  periodicity  of  f(L)  according  to  Theorem 
7  in  this  problem.   Next  suppose  Theorem  3  is  applied.   This  yields 
parent  solution  A  ^  (2,1,0,0)  from  which  is  generated  the  descend- 
ents  A,,A^,A-,  and  A^,,  resulting  in  the  values  F(12),  F(9),  F(6) 

"~1  ~D  ~"11  31 

and  F(3).   Since  g_(l)  /  9^(1)  we  next  solve  the  knapsack  problem 
for  L=13  which,  according  to  Table  A. 3,  yields  A  with  value  V   =12 

and  L,=12.   We  thus  record  F(13)=12  and  proceed  to  evaluate  g 

1  ^  .  . 

and  g   for  the  next  unevaluated  length,  L=ll.   Solving  the  single 
n 

knapsack  problem  for  L=ll  we  get,  according  to  Table  A, 3,  A  = 
(1,1,0,1)  with  V^9  and  L  =11;  upon  generating  descendents  we  get 

^^'\q'    \i'    :^3o'  -31  ^"^  -44  ^^^^  values  F(9),  F(8),  F(6)  and  F(5), 
F(3)  and  (2) .   Next  a  knapsack  problem  for  L=10  is  solved,  yielding 
A= (1,0,0, 2)  with  L=10  and  V=8;  and  descendents  A   ,  A   ,  A    and 
A   with  values  F(8),  F(6  ),  F(4)  and  F(2).   Next  for  L=7  we  find 
g  (l)=0=g  (1)  so  that  F(7)=F(6),  thereby  completing  the  evaluation. 
Upon  eliminating  the  redundant  entries  we  then  get  the  schedule 
of  non-dominated  entries  of  Table  A, 4. 

As  is  apparent  from  this  example  a  potential  shortcoming  of 
the  present  procedure  is  the  extensive  redundancy  that  can  occur. 
For  example,  in  che  above  procedure  F(6)  was  evaluated  three  times. 
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One  major  source  of  this  redundancy  lies  in  the  generation  of 

descendents.   For  each  parent  A   determined  during  problem-solving 

we  desire  of  course  the  values  F(L')  associated  with  every 

descendent  A';  but  if  all  descendents  of  all  parents  A, ,A„,...,A 

— s  — 1  — 2       s-1 

discovered  to  date  have  been  generated  and  evaluated,  then  we  now 

desire  only  those  descendents  A'  which  are  not  a  descendent  of 
-^  — s 

A  ,A  ,...,  or  A   ,.   That  is,  we  wish  now  to  generate  and  evaluate 
—1-2  —s-1  ^ 

only  the  solutions  included  in  the  set  of  descendents  D  which  are 

^  s 

J 
not  included  in  the  set  D   , ,  where  set  D.  is  the  set  ,  U,  S, 

s-1  J  k=l   k  and 

S   is  the  set  of  solutions  containing  A.  and  all  of  its  descendents. 

13      •  s 

These  are  the  solutions    A"  with  a'.'  <  a.  for  all  i  but  with 

—         1—1 

]^ 
a'.'  >  a.  for  some  i  for  each  k,k=i ,  2,  .  .  . ,  s-1 .   To  restrict  genera- 
tion of  descendents  of  A   to  these  solutions  A"  one  possibility  of 

— S  _  c-  -r 

course  is  to  simply  check  the  k  constraints  continually  during  the 
generation  process  to  insure  they  remain  satisfied.   Another  pos- 
sibility is  to  first  determine  what  shall  be  termed  the  base 

solution  (s)  of  which  A   is  an  extension.   The  desired  solutions 
— s 

A"  are  then  simply  those  solutions  which  are  both  an  extension  of 

one  or  more  base  solutions  and  a  descendent  of  A  . 

— s 

To  facilitate  discussion  of  base  solutions  let  us  consider  a 
two-variable  problem  for  which  we  suppose  that  two  solutions 

13.   Although  redundancy  in  the  generation  of  solutions  A  is  hereby 
eliminated,  there  may  still  be  duplicity  in  the  evaluation  of 
particular  F(L)  if  there  exist  alternate  optimum  solutions  for 
length  L. 
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2    2 
A  =(a'  a')  and  A  =(a  ,  a  )  have  been  determined.   As  shown  in 

Figure  3  these  solutions  define  intervals  on  the  a   and  a   scales 
which  have  been  labelled  Y  ,Y  ,Y  ,  X  ,X  ,  and  X  .   We  shall  use 
these  same  labels  to  refer  also  to  the  set  of  integer  values  con- 
tained in  the  interval. 

Considering  first  the  solution  A  ,    suppose  we  denote  by  the 
symbol  ©  the  "or"  operation  and  by  0  the  "and"  operation;   then  the 
set  of  solutions  S   consists  of  all  solutions  contained  in  the  set 
(Y  ©  Y  )  ©  X  .   Similarly  if  we  denote  by  S   the  set  of  solutions 
complementary  to  S   and  by  Y.  the   set  of  integer  values  of  a 
complementary  to  the  set  Y.,  then  S   consists  of  the  set: 


Y^  ©  Y^)  0  X^  =  Y^  ©  Y^  ©  X^  -  Y^  ©  X^  ©  X^ 

That  is,  for  any  solution  A  =  (a  ,a  )  which  is  not  a  descendent 

of  A.  either  a  >  a   or  a  >  a  . 

Similarly  for  A   the  set  S   consists  of  the  solutions 

Y  0  (X   ©  X  )  and  S   of  the  solutions  (Y   ©  Y  )  ©  X  .   Therefore 

the  set  of  descendents  D  which  results  for  both  A   and  A   is 

S  u  S^  consisting  of  the  solutions: 
1    2 

((Y^eY^)  ©X^)  ©  (Y^©  (X^©X2))  -(Y^©  X^^®   X^)  ^  (Y^©  X^) 
Hence  the  additional  descendents  to  be  generated  for  A  having 


0 
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"2  2 

Figure  3.   Intervals  defined  for  a. 


and  a   by  solutions  A   =  ^^i  '  ^o  ^ 

2     2 
and  A   =  (a^  ,  a^  ) . 


(1) 


(2) 


4- 


■+■ 


2     3 
a    a  -^ 

1     1 


X^d)  X^i2) 


Figure  4.   Intervals  defined  for  a   and 

a   by  solutions  A, ,  A^  and  A_ 
2  —1—2      —3 
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already  generated  those  in  D  > is  the  set  Y  0X  ;  this  is  of  course 
the  set  contained  in  set  D  but  not  in  set  D  ,  i.e.  in  the  set 


Y  ©Y  0X   but  not  in  the  set: 


14 


((Y^eY^)  0X^)  0  (Y^0  (x^ex^))  =  Y^e((Y2©Y^)  0  (x^ex^))  ©  X^.  (5) 

To  continue,  suppose  now  that  solution  A   is  determined 

1   2 
having  values  as  shown  in  Figure  4.   Substituting  Y-i©Y   for  Y 

1  2 

and  x!"©X   for  X^  we  now  have  set  S_  consisting  of  the  solutions 

2  2       2  3 

1         1 
(Y  ©Y  )  0  (X  ©X^) .   In  the  same  way  set  D   is  determined  by 

finding  the  intersection  of  S   and  D  : 

((Y2©Y^)  ©  (X2©X^))  0  (Y2©((Y2©Y3)  0  (X2©X^) )  ©  X^ 

=  Y^ffi  ((Y2©Y2)  0  {X^®X^))     ©  ((Y2©Y^)  0  {X'^BX^))     ©  X^  . 
The  set  of  additional  descendents  to  be  generated  is  the  differ- 
ence between  the  sets  5   and  5  ,  (Y   0  X  ) . 

To  put  the  procedure  in  a  more  operational  form  it  is  noted 

that  in  each  of  the  terms  in  the  expression  5   the  range  or  set 

of  permissible  values  of  each  variable  a.  is  of  the  form  a.  >  b.. 

1  1—1 

It  is  therefore  always  possible  to  uniquely  represent  each  term 

in  D   as  a  vector  P= (p, ,p_ , . . . ,p  ).   For  example,  the  three  terms 

1  2     1 

in  (5)  can  be  expressed  as  P=(a  +1,0),  P  =(a  +l,a  +1)  and 

2 
P  =(0,a  +1);  thus  if  a  solution  A  is  not  to  be  a  descendent  of 

A   or  A  .    it  must  satisfy  at  least  one  of  three  options: 
—1-2'  - 

1  1  2 

a  >  a   +  1;  a  >  a   +1  and  a  >  a   +  1;  or  a  >  a^  +  1 .   Or, 

14.   This  further  reduces  to  (Y  ©  Y^)  ©  (X^  ©  X_)  but  this  form 

o    J        2-3 
of  the  expression  is  preferred  for 

present  purposes. 
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in  other  words,  A  must  be  an  extension  of  at  least  one  of  the 

vectors  P  ,  P   and  P  .   The  vectors  P  will  be  termed  bases  or  base 

s  -, 
solutions,  the  set  associated  with  D   beinq  denoted  as  IP  j. 

s  — 

For  a  single  solution  A^  the  set  S   consists  or  tne 

V  k  k 

m  vectors  (a,+ 1,0,0, ...,0),  (0,a^  +1,0, ...,0),..., (0,0,..., a  +1). 
12  m 

)^ 

For  compactness,  however,  the  values  a.+l  will  commonly  be  repre- 

k      k        k 
sented  in  a  single  vector  H=(a   +1,  a_+l,...,a  +1). 

12         m 

Finally,  each  term  in  the  expression  defining  the  subset  of 

solution;,  contained  in  set  D   ,  but  not  in  set  5   is  of  the  form 

s-1  s 

T,  0  T^  ©  ...  0  T  ,  where  T.  represents  the  set  of  permissible 
12  m         J    '^  ^ 

values  of  a . :  n.,  n.  ,,...p.  (where  possibly  n.=p.=0).   Therefore 
J    J    J+1      J  J   J 

the  set  of  solutions  lA"  }  defined  by  each  term  can  be  defined  by 

two  vectors  P  and  C,  where  P  is  the  base  solution  with  b.=n  , 
_     _        _  J   J 

all  j,  and  C  is  a  vector  with  c.=p.-n.,  all  i.   The  set  (a"}  is 
-  J   J   J  - 

thus  the  set  (P+Aj  generated  by  the  set  {Aj  of  descendents  of  C. 
For  example,  the  set  of  solutions  (Y   ©  X   )  that  is  in  set  5 

but  not  in  set  D^  is  completely  defined  by  base  solution  P^  = 

2       1  3    2     3    1 

(a^  +1,  a^  +1)  and  vector  C  =  (a   -a   ,  a   -a   ) . 

With  this  notation  we  may  sum  up  the  discussion  with  the 

following  theorem: 

Theorem  10:  Let  A^,A  , ...,A   be  solutions  to  a  knapsack  problem (1) 

s-1 
and  let  {P_    )  be  the  set  of  bases  for  the  set 

D^_^,  s>  1,  where  A^  =  (0,0,...,0),  P°=  (0,0,...0), 
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and  S   is  the  set  of  solutions  consisting  of  A   and  its 

s    s      s 
descendents.   Let  H  =(h,,  h^,...,h  )  represent  the  set 

s    12      m 

—  s    s 

of  solutions  S  ,  where  h.  =  a.  +1  for  all  i,  and  let 

s  1      1 

s-1  s-1 

{P    )*  be  the  subset  of  the  base  solutions  {P    )  for 

s-1     s 
which  p.    <  h.   for  all  i.   Then: 
1   —  1 

(i)   The  set  of  bases  {P_    ]   consists  of  the  subset 

s-1  s-1 

of  {£    )  not  contained  in  {£    ]* ,    together 

with  the  m  base  solutions  £  ,  £  ,  ...,  £.->•••£ 

1.    z  J 

s-1 
derived  from  base  P^     =  (p,  jP-,^  •  • -P  )  by 

-t       '^1"=^2     m 

setting  p.     =  p.,  i   9^    ] ,    and  p.    =h . ,  for 

s-1  ,  s-1 , 

each  base  P      m  the  set  {P    }* . 

(ii)  The  solutions  in  set  D  which  are  not  included 

s 

in  set  D^_^,  are  those  in  the  sets  {p  ^~"'"+A  ^~^  ] , 

where  there  is  one  such  set  for  each  base 

s-1  s-1 

P      in  the  set  (P    )*,  and  where  the  solu- 
— t  — 

r   s-1    s-1  , 
tions  in  the  set  IP     +A      j  are  the  solutions 

— t    — t 

which  are  both  a  descendent  of  A   and  an  extension 

— s 

s— 1  s— 1     s—1 

of  P^    ,  i.e.  all  solutions  P     +  hu  fo^ 


s-1  s-1 

solutions  A.     descendent  from  (A  -P^    )  . 
t  "S  — 


Proof  follows  by  representing  the  indicated  sets  in  terms  of  the 
solutions  A  ,  A  ,  ...,  A  ,  performing  the  indicated  set  operations 
and  simplifying,  and  then  representing  the  resulting  sets  in  terms 
of  the  indicated  vectors  just  as  was  done  in  the  preceding  dis- 
cussion. 


-29- 


In  principle  the  number  of  base  solutions  in  the  set  {P_  ) 

may  become  quite  large  since  each  new  solution  A  give, rise  to 

m  additional  bases  for  each  base  B   of  which  A   is  an  extension. 

— s  — s 

In  practice,  however,  it  may  be  possible  to  eliminate  some  of 

them  through  dominance  and  feasibility  considerations: 

k    k         k 
Theorem  11:  Let  P,  =  (p, ,  P  ,  . • . ,  p  )  be  any  base  solution 

^c     1    2        m 

for  the  set  D   at  stage  s  in  the  evaluation  of 
s 

F(L),  and  let  L  be  the  largest  unevaluated  value 

of  L.   Let  i"   =  'I  1.  p.   be  the  length  of  P   and 
k    i_   J.   1  k 

]^ 

7,  -^  ^'  v .  p.  its  value.   Then  base  P,  can  be  eliminated 
k    ^   1  ^1  — k 

from  explicit  consideration  at  stage  s  and  all  suc- 
ceeding stages  when  any  of  the  following  conditions 
are  satisfied. 

(a)  l^    >   L 

(b)  y^      <   F{£^) 
(c)  \  <  B(i^) 

(d)  y,     <    y      and  i,  >  i   for  any  other  base  P 

at  the  present  stage. 

where  F(L)  is  the  maximum  value  obtainable  for  a  knapsack  of 

length  L,  and  B(L)  is  a  lower  bound  on  the  maximum  attainable 

value. 

To  prove  the  theorem  consider  first  the  present  stage,  s, 

(a)  follows  since  there  can  exist  no  feasible  solution  A   having 

— s 
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length  L   <  L  of  which  P   is  a  descendent  when  £      >  L.       (b) ,  (c) 

S  K.  rL 

and  (d)  all  follow  from  the  fact  that  for  every  feasible  solu- 
tion A  to  knapsack  problem  (1)  for  length  L  which  includes  £  as 
a  descendent,  there  exists  another  feasible  solution  A'  with  value 
larger  than  that  of  A  which  is  determined  from  A  by  simply  replac- 
ing the  length  £      utilized  by  P_  ,  by  P  ,  in  the  case  of  (d)  ,  and 
by  the  appropriate  feasible  solutions  determining  F{£.)    and  B(i  ) 

in  cases  (b)  and  (c) .   Thus  £  can  be  eliminated  for  stage  s. 

k 

It  remains  to  show  that  no  base  solution  P'  for  stage  s+i 

— k 

s+  i 
derived  from  P,  need  be  Present  in  the  set  {p  ■'  }  .      However,  this 

— k  — 

follows  immediately  from  the  facts  that  every  base  p'  is  either 

— k 

identical  to  or  an  extension  of  P   (Theorem  10) ,  that  any  ex- 

K. 

tension  of  a  nonfeasible  solution  is  nonfeasible,  and  that  any 
extension  of  a  dominated  solution  is  dominated. 

Referring  once  again  to  the  example  in  Appendix  A,  we  begin  as  befbiE 
by  setting  F(0)=F(  IK)  and  by  applying  Theorem  3  which  yields  A=(2,l  0,0) 
and  descendents  A  ,  A  ,  A   ,  and  A    and  values  F(12),  F(9),  F ( 6) 
and  F(3) .   From  A  we  determine, according  to  Theorem  10,  H={3,2,1,1) 
which,  given  P   =  (0,0,0,0),  yields  the  base  vectors  P.  ,P.-,  P,  and 
P   as  phown  in  Table  A. 5.   Applying  Theorem  11  with  L  =  13  we  find 
that  P   is  nonfeasible  and  P   is  dominated  so  that  {P_    ]    =    {P.^jP^5. 
Next  we  solve  the  knapsack  problem  for  L=13  and,  as  before,  get 
solution  A  with  length  12  and  value  F(12) .   Since  we  already  have 
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this  solution  and  its  descendents  we  proceed  as  before  to  update 

bounds  and  to  solve  a  problem  with  L^ll,  getting  A^-  (1,1,0,1) 

with  length  11  and  value  F(ll) .   Examination  of  the  set  {£  ) 

shows  A.  to  be  an  extension  of  P .  so  that  the  set  of  new  descend- 
—4  —4 

ents  to  be  generated  is  the  set  {P..+A),  for  all  descendents  A  of 

(A4-P4)  =  (1,1,0,0):  (1,1,0,1),  (1,0,0,1),  (0,1,0,1)  and  (0,0,0,1) 

with  values  F(ll),  F(8),  F(5),  and  F(2).   Forming  the  vector 

H=(2,2,l,2)  and  determining  the  intersection  with  P   we  get  bases 

P^,P^,P   and  P„.   Since  P^  is  nonfeasible  and  P^  and  P^  are  both 
—5—6—7—8         —5  —6—7 

2  ^ 

dominated,  we  have  (P  }  ^  (P  ,  P^ ) .   Now  L  =  10  as  before,  and 

again  solving  the  knapsack  problem  we  get  A   =  (1,0,0,2)  with 

length  10  and  value  F(10) .   Since  A^  is  an  extension  of  P   the 

descendents  generated  become  (1,0,0,2)  and  (0,0,0,2)  with  values 

F(10)  and  F(4).   Forming  the  intersection  of  H=(2, 1,1,3)  with 

P^  we  get  P^ ,  P^^,  P  ^  ,  and  P    all  of  which  are  dominated  or 
o         ~~3  10    11       12 

nonfeasible,  so  that  {P_  )  =  (P.-,  i  •   As  before  we  next  find  that 
g   =  0  so  that  F(7)  =  F(6) , which  therefore  completes  the 
evaluation . 

Up  to  this  point  the  motivation  for  and  use  of  base  solutions 
has  been  as  a  means  through  which  redundancy  could  be  reduced  in 
the  generation  of  descendents.   In  addition,  however,  they  can  also 
be  used  more  directly  to  sometimes  make  the  evaluation  process 
for  a  given  knapsack  length  I,  =  L  more  efficient,  as  suggested  by 
the  following  theorem: 
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Theorem  12:   Let  A, ,A^,  ...,    A.,...,  A  be  solutions  to  a  knapsack 

—1—2       — J       — s  ^ 

problem,  where  A.  is  an  optimal  solution  for  length 

L{A.) ,  j=l,2,...,s;  and  let  D   denote  the  set  of 
J  s 

descendents  for  A, ,A^,...,  and  A  .   Let  B(L)  and  U(L) 

~"1  —2  ~s 

be  the  bounds  on  F(L)  as  determined  according  to  (4) 

on  the  basis  of  solutions  in  the  set  D  .for  all 

s' 

s 
0  <  L  <  L    .   Let  (P  J  be  the  set  of  base  solutions 
—   —  max        — 

— s  s 

for  the  set  D  ,  where  base  solution  P_  has  length 

iq  and  value  7q, and  let  L  be  any  unevaluated  length. 

Then: 

(i)   If  A  is  any  solution  in  the  set  D  which  is 

feasible  for  L=L  and  which  maximizes  the  value 

Z   V. a . ,  then: 
i   1  1 

B(t)s  max  (7   +  B(L-i  ))  <  V{A)  <  max(7  fU(L-i  )) 

qq      q---qq     q 

U(L)  . 

(ii)    If  D(L)  <  B(L)  then  there  exists  an  optimal 

knapsack  solution  for  L  =  L  in  the   set  D  . 

(iii)   -^.f  (  7     -  B(L  -  f  )  =  U(L)  then  (P  -t-  A  >  is 

q       q  *q  -q 

an  optimal  solution  for  L  =  L  among  solutions 

in  the  set  D  ,  where  A    is  any  solution  with 
s         -q 

value  B(L  -7)  and  length  L(A   )  <(L  -    £   )  . 

q  ~  q  ~     q 

If  U  (L  )  >  B(L)then  (P  f  A  ^  is  an  optimal 

-         -q  "q 

solution  among  both  sets  D   and  D  . 
^  s      s 
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(iv)    If  7.  +  U(L-i.)  <      y      +   B(L  -  /  )  for  any  base 

J       J  ~   q        q 

s      s 
solutions  P  .  and  P   then  there  exists  an  optirnal 

"J    -q 

solution  with  value  F(L)  which  is  not  an  ex- 

s 
tension  of  base  P . . 

-J 

To  prove  the  theorem  it  is  noted  that  if  A*  is  an  optimal  solution 

for  lenqth  L  then  by  the  definition  of  the  sets  D   and  5   it  must 
^  -^  s       s 

be  in  one  or  the  other.   By  the  derivation  of  (4)  it  has  value 

B(L)  <  V(A*)  <  U(L)  regardless  of  the  set  it  is  in,  and  strictly 

value  B(L)  if  in  set  D  .   If  in  5   then  by  Theorems  10  and  11  it 

— s  s 

,  s 
is  an  extension  of  at  least  one  base  solution  in   IP.  1 •   If  it  is 

s  '■*■ 

an  extension  of  P   then  it  has  value:  y    +  B(L-^   )  <  V(A*)  <  7  f 

-q  q     q   -   -   -  q 

U(L-  7  )  so  that  if  it  is  an  extension  of  any  base  solution  in 

q 

[P     )    then  V{A*)     >  max    {7    +B(L-i    ) ],    and   V(A*)     <  max    \y    +U(L-i    ) ], 

-q  ~~qqq        ~      "  qq 

as  stated  in  part  (i).   Proof  of  Parts  (ii),  (iii)  and  ( iv)  then 
follow  immediately  from  part  (i)  and  the  definitions  of  B(L) , 
U(L)  and  U(L) . 

To  illustrate  the  use  of  the  theorem  let  us  consider  again 
the  example  as  it  was  solved  with  the  last  procedure.   Upon  apply- 
ing Theorem  3  we  got  F(12)=12,  F(9)=8,  F(6)==6  ana  F(3)=2,  and  upon 
determining  the  base  solutions  and  applying  Theorem  11  we  got 

{P  )  =  (p.,,  PJ  with  i^  =  5,  7  =3,  £^    ^    2   and  7_  -  1.   Turning  to 
—      —3—4        334  4 

L  =  13  we  find  that  B(13)=12,  U(13)=13,  B(13)=max  [(r  +B(8)), 

(7  +B(11)]  =  11,  and  U(13) =max [ (73+U(8) ) ,  (74+U(ll) ) ]  =  13.   Hence 
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there  may  possibly  exist  an  optimal  solution  for  'l==13  in  the  set 
S  (in  which  case  it  must  be  an  extension  of  P_     since  7-.+U(8)  <B(  13)  )  . 
Therefore  we  solve  the  knapsack  problem  for  L=13,  getting  solution 
A  with  L  =12  and  F(12)=12  which  we  have  already  obtained.   Thus  we 
turn  to  the  evaluation  of  L=ll  and  compute  B(ll)=8,  U(ll)=12, 
B  (11)  =9=U(11) .   Since  U(ll)  >  B(ll)  and  both  solutions 
(£3+^3)^(0,0,1,0)  +  (1,0,0,0)  and  (P4+A4)  =    (0,0,1,0)  +  (1,1,0,0) 
have  value  U(ll),  both  constitute  optimal  solutions  for 'l=11, 
yielding  F(ll)=9.   Generating  descendents  of  both  we  get 

F(8)=7,  F(5)=3  and  F(2)=l,  and  determining  the  new  set  of  base 

2 
solutions  and  applying  Theorem  11  we  get  {P  )  =  {Fg  )  with  i=4 

and  7=2.   Next  we  consider  L=10  for  which  it  is  determined  that 

B(10)-8,  U(10)=9,  B(10)=8  =  U(10);  again  since  U(10)  >  B(10)  and 

since  solution  (Pq+A.)  =  (0,0,0,2)  +  (1,0,0,0)  attains  value 

o   o 

—  .  '■» 

U(10) ,  (P^+A„)  constitutes  an  optimal  solution  for  L=10.   Generat- 
~8  ^8 

ing  descendents  we  get  F(4)=2.   As  before  we  now  find  that  g, (1)  =0 
so  that  F(7)=F(6)  which  therefore  completes  the  evaluation. 
Hence  by  directly  employing  the  base  solutions  in  the  evaluation 
process  it  has  been  possible  in  the  example  to  reduce  to  one  the 
number  of  knapsack  problems  that  needed  to  be  solved  explicitly 
in  evaluating  F(L) . 

Returning  at  this  point  to  the  problem  of  redundancy,  we 
discussed  earlier  how  a  major  source  of  redundancy  can  be 
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eliminated  through  the  use  of  base  solutions  in  the  generation  of 
descendents  of  a  new  parent  solution.   Redundancy  still  occurs, 
however,  whenever  in  solving  a  knapsack  problem  explicitly  the 
resulting  solution  is  the  same  as , or  the  descendent  of , a  solution 
already  obtained.   This  occurred  in  the  example  just  considered 
when  solution  of  the  knapsack  problem  for  L=13  yielded  solution  A. 
with  length  L  =12  and  value  F{12),  a  result  already  obtained 
through  use  of  Theorem  3. 

To  minimize  redundancy  arising  in  this  manner  two  alternatives 
will  be  considered.   One  is  to  directly  constrain  the  search  space 
when  seeking  the  value  F(L)  so  that  no  feasible  solution  is  con- 
sidered  having  the  value  F(L)  of  any  length  L  already  evaluated, 
with  the  one  possible  exception  of  a  solution  with  value  F(L  +  6  )  . 
This  approach  eliminates  considerable  redundancy  but  may  necessi- 
tate the  solution  of  a  large  number  of  individual  knapsack  problems. 
This  approach  is  discussed  briefly  in  Section  III. 

The  other  alternative  to  be  considered  consists  in  constraining 
the  search  to  solutions  which  are  not  descendent  from  any  previ- 
ously evaluated  parent  solution.   This  approach  fails  to  eliminate 
redundancy  completely  in  so  far  as  an  alternate  optimum  solution 
may  be  generated  for  a  value  F(L)  already  evaluated.   It  also 
requires  more  bookkeeping  to  implement.   However,  its  use  may 
possibly  necessitate  the  solution  of  fewer  individual  knapsack 
problems.   This  approach  will  be  discussed  in  more  detail  in  Section  Qt 


-36- 
Before  turning  to  these  alternatives  it  is  noted  that  an 

additional  matter  requiring  consideration  is  the  amount  of  effort 

to  be  expended  in  trying  to  eliminated  particular  lengths  1 .  from 

the  problem  before  evaluation  of  F(L)  commences.   For  in  general, 

length  1.  can  be  eliminated  from  the  problem  (i.e.  set  a .  =  0  in 

all  solutions)  if  there  exist  any  set  of  non-negative   integers 

e.  such  that: 

1 

2   e.l.  <  1.   and   S   e.v.  >  v.  (6) 

•  /.   11—  J       ...   11—  J 


As  noted  earlier  one  reason  for  wishing  to  eliminate  a 

dominated  length  1 .  is  that  when  1 .  ,  <  1 .  >  1 .  ,  and 

J  J-1     J     J+1 

1 .  ^  >  1 .  ,  its  presence  can  significantly  limit  the  potential 
j-1     j  +  1     ^  ^  ji  f 

use  of  Theorem  4.   In  the  illustrative  problem,  for  instance, 
with  1   eliminated  from  the  problem  the  number  of  values  F(L) 
determined  from  the  theorem  is  increased  from  5  to  9 ,  thus  reduc- 
ing the  number  of  individual  knapsack  problems  to  be  considered 
explicitly.   Another  reason  is  that  the  elimination  of  lengths  1. 
can  significantly  affect  the  value  of  h*,    the  length  beyond  which 
the  function  f(y)  may  be  assumed  periodic.   In  the  sample  problem, 
for  instance,  elimination  of  1   would  reduce  L*  from  32  co  7,  thus 
simplifying  the  evaluation  process.   Still  a  third  is  that  the 
elimination  of  such  lengths  1.  can  materially    affect  the  problem- 
solving  time  required  to  solve  a  given  knapsack  problem  (1)  for  a 


15.   See  Footnote  #5  on  page  9 
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single  length  L.   However,  the  identification  of  such  dominated 
lengths  can  be  time-consuming   ;  therefore  in  practice  a  trade-off 
must  be  made  in  diverting  problem-solving  time  from  evaluation 
per  se  to  pre-analysis  of  the  data.   This  is  a  subject  requiring 
subsequent  empirical  investigation. 


16.   Procedurally  they  can  be  identified,  for  instance,  through 
use  of  the  algorithm  given  in  Section  III  . 


-se- 
ll I.  Controlled  Interval  Search  Procedures 

As  was  suggested  in  the  previous  section,  one  further  means 
of  minimizing  redundancy  in  the  evaluation  of  F(L)  (in  addition  to 
using  base  solutions)  is  to  limit  search  when  evaluating  F(L)  to 
solutions  such  that  F(L')  <  V  <  F(L  +  6),  where  V  is  the  value  of 
a  potential  solution  for  a  knapsack  problem  with  length  L,  L  is 
the  largest  remaining  unevaluated  length  and  l'  is  the  largest 
evaluated  length  less  than  L.   By  restricting  search  to  solutions 
with  value  V  in  the  range  F(L')  <  V  <  F(l,  +5)  it  is  guaranteed 
that  no  previously  generated  solution  is  rediscovered.   If  in 
this  limited  search  an  optimal  solution  A*is  discovered  then  F{L)= 
V{A*)  for  all  L,  L(A*)  <  L  <  L.   In  such  a  case  all  previously 
ungenerated  descendents  are  generated  and  evaluated,  and  the  new 
set  of  base  solutions  determined.   On  the  other  hand  should  no 
feasible  solution  with  value  in  this  range  be  found  for  length  I, 
then  F(L)  =  F(L  -&)=...=  F(L').   In  either  case  bounds  are 
then  updated  and  all  solutions  which  can  be  inferred  from  these 
bounds  determined  and  evaluated.   The  procedure  then  repeats  for 
the  largest  remaining  unevaluated  length  L  until  all  lengths  have 
been  evaluated. 

Throughout  this  procedure  the  knapsack  problem  being  solved 
explicitly  in  each  instance  is  a  constrained  knapsack  problem  of 
the  form: 
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Maximize:    V   =   Zv . a . 
Ill 

Subject    to:    Zl.a.    <  L  ^^^ 

11   — 

V''"   <  V   <  v" 

and  a.  >  0,  integer  all  i 

1      u 
where  V   and  V   represent  lower  and  upper  bounds  on  the  acceptable 

value  of  the  solution.     Such  a  problem  is  readily  solved  with 

any  of  the  existing  one-dimensional  knapsack  algorithms,  but  a 

combinatorial  programming  algorithm  of  the  type  described  in 

references  [6]  and  [12  J  is  especially  well-suited  for  the  problem 

since  it  explicitly  utilizes  the  bounds  V   and  V   to  reduce  search. 

To  facilitate  subsequent  discussion  a  complete  algorithm  of  this 

type  is  stated  below: 

(i)       Order  the  lengths  so  that  0, >  0^  >  ...  >  0    ,    where  0 .    = 

1—  2  "~     —  m         1 

v./l. •   Set  G  =  v"  -  V  . 
1   1 

(ii)       Set  a^  -  \l  )  '  ^2  "  \ 1 /  '  *  "  *'  ^"  " 


1  2 


m 


< 


m-1 


(L-  Z         1  .a.)  V 

i-.!   J  J  \  ««  "^  L 

' /  ;  d  =  L  -  "^   1 .  a ,  and  V  ^-  Z   v .  a  .  -  V 

1     /  .,11  .,11 

m   '  1=1  x=l 


(iii)       If  V  >  0,  a  solution  with  value  exceeding  the  lower 

bound  has  been  discovered.   Go  to  step  (iv) .   Otherwise 
go  to  step  (v) . 


17.   As  a  lower  bound  we  can  always  use,  for  example,  the  value 

V   =  F(L')  -^  h,  where  h  is  the  largest  factor  common  to  each  of 

the  values  v  ,  v^ ,  ....  v  ;  for  the  upper,  of  course,  V  =F(I*5), 
12         m 
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(iv)       If  V  =  G  terminate  problem-solving  since  a  solution  A 

with  value  equal  to  the  upper  bound  has  been  discovered. 
If  V  <  G  set  G"  =  G  -  V,  V  =  0;  save  A  as  the  best 
solution  discovered  so  far  and  go  to  step  (v) . 

(v)       If  there  is  an  i,  1  <  i  <  n»-l  such  that  a.  >  0  let  j 
be  the  largest  such  i  and  go  to  step  (vi) .   Otherwise 

there  exists  no  more  candidate  solutions  so  that 

problem-solving  is  complete.   Go  to  (viii) . 

(vi)       Set  a"  =  a,  ,  al  =  a„,  ....  a'    =  a.   ,    and  a '.  =  a .  -  1 
112     2        j-1     j-i'         J     J 

IfV-v.    +  0  .       (d   +    1.)     <Ogoto    (vii)  .      Otherwise    set 

m 

m  J+1 

1    \    ,    V'     =V-v.    +   Z      v.a'.  ,    d'    =   d   +    1.    - 

V  J         j+1    ^    ^  J 

m 
S        l.a! .      Go   to   step    (iii) . 

.,11  Jr      ^  / 

(vii)  Set   a'.    =0        V    =V-v.a.,    d'    =d-i-    l.a.    and    return   to 

J     '  J  J  J  J 

step  (v) . 

(viii)       If  G  =  V   -  V   no  feasible  solution  has  been  found  to 

u     1 
the  problem.   If  G  <  V   -  V   then  the  best  solution 

discovered  is  A  with  value  V   -  G. 


-H    1- 


From  these  steps  it  is  clear  that  the  more  stringent  the 

1      u 
bounds  V   and  V   the  greater  the  potential  savings  m  problem- 
solving  effort.   It  may,  therefore,  be  desirable  to  use  the  more 
stringent  bounds,  V   =  B(L)  -(-  h  and  V   =  U(L)  ,  where  B(L)  and 
U{L)  are  the  bounds  defined  in  (4) ;  or,  in  the  event  base  solutions 
are  being  employed  in  the  evaluation  process,  to  use  the  bounds 
V   =  [max  {B(L) ,  B(L) )  +  hj  and  V^  =  min  [U(L),  U(L)]  where  B(L) 
and  U(t)  are  as  defined  m  Theorem  12,  and  h  is  the  largest  factor 

common  to  the  values  v, ,  v^,  ...,  v  .   Use  of  these  more  stringent 

12         m 

bounds,  however,  will  not  necessarily  guarantee  a  more  efficient 
algorithm  iri  toto  since  in  the  event  there  is  no  feasible  solution 
with  value  in  the  range  V   and  V   it  becomes  necessary  to  then 
ascertain  the  feasible  solution  which  yielded  the  value  (V   -  h) , 
a  task  which  may  or  may  not  offset  the  savings  in  search. 

As  an  illustration  let  us  consider  the  explicit  solution  of 
the  knapsack  problem  with  L  =  13  which  arose  in  the  example  of 
Section  III.  From  the  application  of  Theorem  3  we  have  the  bound 

B(13)  =  F(12)  =  12,  and  since  h  -  1  for  the  given  values  of  v. , 

1  u 

we  therefore  get  V   =13.   For  V  we  employ  the  value  0  -L  -    13 

since  there  exist  no  values  F(L)  for  L  >  13.   Commencing  the 
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algorithm  at  step  (i)  we  proceed  in  order  through  steps  (ii) , 
(iii) ,  (v) ,  (vi) ,  (vii) ,  (v)  and  then  to  step  (viii)  where 

problem-solving  terminates:  there  exists  no  feasible  solution  for 

L  -  13  with  value  13. 

While  the  algorithm  has  been  found  to  be  quite  efficient 

18 
in  the  form  as  stated   ,  it  is  noted  in  conclusion  that  possibly 

it  might  be  made  more  efficient  through  one  or  more  changes.   For 

example,  according  to  Theorem  6  there  exists  for  each  length  1   a 

r 
maximum  length  L   that  need  ever  be  composed  of  lengths  1    , 

1   -,...,  1   in  an  optimal  solution  for  a  problem  of  length  L, 
r+2        m  '^  ^  y 

r 
i.e.,L„>l   ,a   ,-1-1   _a   ^-i-...,  la.   Thus  it  might  prove 
0  —  r-t-1  r-hl     r-t-2  r-i-2         m.m  ^    x- 

J  j 

useful  to  include  a  test  to  insure  that  Z   l.a.  >Li,  i=l,  2, 

,11—0 
1  =  1 

...,  m  -  1,  although  this  represents  substantial  testing  time. 

Alternately  it  might  perhaps  prove  more  efficient  to  simply  check 

that  a   does  not  drop  below  the  value   ("(L  -  L-)/l  )  -i-  .99  ...  9/. 
1  ^       0    1  >* 

Either  test  is  readily  incorporated  in  the  algorithm  by  modifying 

slightly  steps  (ii)  and  (vi) .   Another  possibility  is  to  impose 

upper  bounds  on  the  variables  a.:  as  was  mentioned  in  Sectionll, 

in  no  optimal  solution  need  a.  exceed  the  value  (d .  -  1) ,  where 

1  1 

d.l.  =  b.l,  for  nonnegative  integers  d.  and  b..   Thus  in  steps  (ii) 

llll  ^  XX  f        \        I 


18.   The  results  of  a  comparative  study  of  knapsack  algorithms 
will  be  presented  in  a  subsequent  report. 


-43- 


and  (vi)  of  the  algorithm  a.  could  be  set  to  min  [(d.  -  1) , 
i-1 


/ (L  -  7   1  a  ) /I    ].   Still  other  possibilities  derive  from  the 
,    J  J    i 

results  of  Glover  [9  J  which  may  profitably  be  used.   These  all, 
however,  remain  possibilities  for  future  investigation. 

IV.   Controlled  Parent-Generation  Search  Procedures 

As  suggested  in  Section  JI  another  means  for  minimizing 

redundancy  in  the  evaluation  of  F(L)  (in  addition  to  the  use  of 

base  solutions)  is  to  control  the  search  process  so  that  in  solving 

a  knapsack  problem  for  length  L  the  solution  which  results  is  in 

no  instance  a  descendent  of  any  solution  already  determined.   In 

this  section  a  procedure  of  this  type  will  be  discussed  which,  like 

that  in  Section  jll,  begins  with  the  largest  unevaluated  length  L 

and  proceeds  stage  by  stage  toward  length  L  =  0,  but  which,  unlike 

that  in  Section  HI,  always  yields  a  feasible  solution  for  each 

knapsack  problem  of  length  L  explicitly  solved  —  although  its 

value  may  not  exceed  the  bound  B(L) . 

To  be  more  explicit  let  us  consider  Theorem  13  upon  which  the 

underlying  search  process  is  based: 

Theorem  13:    Let  A,,  A^,  ...,  A.,  ...,  A   .  be  solutions  to 

—1—2         J        — s  - 1 

knapsack  problems  in  which  A.  is  optimal  for  length 

L(A.)  among  all  solutions  in  the  set  D    -  tt  c 
-J  J-1  -  K   k' 

where  S   is  the  set  of  solutions  consisting  of  A^ 
k  '^ 
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and  all  of  its  descendents.   Let  B(L)  denote  the 

largest  value  ?"  v.  a.  attainable  among  solutions 
ill 

in  the  set  D   ,  with  length  L  <  L,  for  all  un- 
s-1         ^     — 

evaluated  lengths  L.   And  let  A  be  an  optimal 

solution  in  the  set  D   ,  for  the  largest 

s-1 

unevaluated  length,  L.   Then: 

(i)        F(L)  =  max  [B(L),  V(A  )]  for  all'L, 

"~S 

L(A  )  <  L  <  L. 
— s   ~   ~ 

(ii)       F(ti)  ^  Bit)     for  all  L  such  that 

B(^)  >  V(A  )  . 

—   — s 

(iii)      F(L')  =  max  [b(L'),  VXA' )  ]    for  all  descendents 

A'  of  A  heretofore  unevaluated.- 
s      s 

Proof  of  the  theorem  follows  from  the  fact  that  since  the  sets 

D    and  D    are  complementary  an  optimal  solution  for  every  length 

L  must  be  contained  in  at  least  one  of  the  sets.   For  each  un- 

evaluated  length  L,  B(L)  constitutes  the  maximum  value  attainable 

among  solutions  in  D    ;  hence,  for  any  unevaluated  length  L*.  if 

O  ""  i 

V(L*)  is  the  maximum  value  attainable  among  solutions  in  D 

^  ™"  X 

then  F(L*)  =  max  [B{L*),  V(L*)j.   Therefore  since  solution  A   is 

—  A 

optimal  among  solutions  D  _   for  length  L  it  is  by  Theorem  2, 
optimal  among  solutions  D     for  all  lengths  L(A  )  <  L*  <  L,  and 

O  "^  i  ta 

therefore  F(L*)  can  be  evaluated  for  each  length  L(A  )  <  L*  <  L 
as  stated  in  part  (i) .   If  A   is  optimal  among  solutions  in  set 
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D    then, by  Theorem  1,  all  descendants  A"  are  also  optimal  among 

solutions  in  set  D   ,  ,  and  hence  F(L*)  can  be  evaluated  for  all 

s-1 

lengths  L(A'),  as  stated  in  part  (iii).   Finally,  proof  of  part  (ii) 
of  the  theorem  follows  directly  from  the  fact  that  V(A  )  is  the 
maximuin  attainable  value  for  lengths  L  among  solutions  m  the  set 

D   ,  and  therefore  if  a  higher  value  is  attainable  from  a  solution 

s-1 

in  D   ,  then  it  must  be  optimal. 
s-1 

With  Theorem  13  as  the  basis  the  procedure  may  now  be  stated 

simply  as  follows.   The  procedure  begins  with  L     and  proceeds 
^  max 

stage  by  stage  with  the  evaluation  of  the  largest  remaining  un- 
evaluated  length  I .   For  each  length  L  attempts  are  first  made  to 
evaluate  F(I,)  by  direct  means,  by  bounding  considerations,  by  use 
of  base  solutions,  etc.,  as  in  the  procedures  m  Sections  11  and  HI. 
When  all  of  these  preliminary  attempts  fail  F(L)  is  then  evaluated 
through  use  of  Theorem  13  by  determining  a  solution  A  which  is 

~"S 

A  — 

optimal   for  length  I  among  the  solutions  in  the  set  D    .  where 

A,,  A„,  ...,  A   are  the  parent  solutions  which  have  been  determined 
~1   ~2        ~s-i 

thus  far  in  the  evaluation  process.   Upon  finding  P     .all  of  its 
previously  ungenerated  descendents  are  generated  and  all  of  the 
lengths  I  identified  in  Theorem  13  evaluated.   The  procedure  then 
continues  on  with  the  next  largest  remaining  unevaluated  length 
until  all  lengths  have  been  evaluated. 
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Within  this  procedure  there  remains  the  task  of  solving  the 
constrained  knapsack  problems  which  result  when  the  preliminary 
attempts  fail  in  the  evaluation  of  F(L) .   In  each  such  case  the 
problem  is  of  the  form: 


Maximize        V  =  Zv . a . 

.  1  1 

1 

A 

Subject  to:      21 . a .  <  L 

^11-  (8) 

]^ 
a.  >  a.  for  some  i,  all  k  =  1,  2,  ....  s-1 
11 

a .  <  d .  all  i  =  2,  3,  ...  ,  m 
1-1 

a   >  W(L) 

and  a.  >  0,  integer,  for  all  i 

where  d.  is  the  upper  bound  on  a.  and  W{L)  =  <f  (  (L  -  L ' ) /I  )  + 
.99  ...  9j>^   the  lower  bound  on  a   as  discussed  in  Section  ]II. 
To  solve  the  problem  we  can  employ  the  combinatorial 

programming  algorithm  discussed  in  the  preceding  section.   With 

u       1 
the  bounds  V   and  V   taken  to  be  F(L  +  5)  and  0  respectively,  the 

only  mandatory  modification  for  solving  the  present  problem  (8)  is 

to  ascertain  the  feasibility  of  a  solution  A  before  retaining  it  as 

the  best  discovered  so  far.   Thus  in  step  (ii)  in  the  algorithm  V 

is  initially  set  to  0.   Step  (iii)  is  then  divided  into  (iii.a)  and 

(iii.b),  where  (iii.b)  becomes  the  present  step  (iii)  and  step 

(iii.a)  becomes: 
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(iii.a)      If  a.  >  a.  for  some  i,  all  k  =  1,  2,  ...,  s 

go  to  step  (iii.b) .   Otherwise  go  to  step  (v) . 

With  these  changes  the  algorithm  yields  an  optimal  solution 
to  (8)  whenever  a  feasible  solution  exists. 

For  the  present  problem,  however,  it  may  be  possible  to 
improve  the  efficiency  of  the  algorithm  through  the  incorporation 

of  one  or  more  additional  tests  within  the  procedure.   For  example, 

]^ 

consider  the  requirement  that  a.  >  a.  for  some  i.   When  this 

11 

requirement  is  satisfied  by,  say  a  ,  then  an  upper  bound  on  the 
value  of  V  becomes  0    (L  -  1.  a.  )  +  Va.s^.•   Choosing  among  all 
possible  ways  of  satisfying  a.  >  a.  one  which  yields  the  highest 
upper  bound  we  have 

vj^    =   max    r0    fL    -    1.  (a^    +    D)    +   V,  (a^   +    1)  J 
0.1  11  11 

1 

=  jET  L    -  min    (0      -   0. )  (1.)  (a^   ^    1) 
i 

V   thus  constitutes  an  upper  bound  on  V  given  that  constraint 

]^ 

a.  >  a.  has  yet  to  be  satisfied  for  some  i  >  0.   More  generally, 
11 

if  at  a  given  stage  of  enumeration  the  values  a'   a^  ,  ...,  a'. 

]^ 

have  been  specified  and  constraint  a.  >  a.  still  remains 

11 

unsatisfied,  the  bound  becomes: 


-48- 


k     J  J  k 

V   -   Zv^a^  +  ,0"    (L  -  2:i^a^)  -  min  (0     -  0.)(l.)(a.  +  1)    (9) 

^1         -'        1         l>j    -^ 


If  we  denote  by  Q.  the  set  of  indices  k  for  the  constraints 
"a.  >  a."  not  yet  satisfied  after  the  specification  of  a'   a' 
...,    a'.,  an  upper  bound  on  V  at  the  completion  of  stage  j  when 
considering  all  constraints  is 

-  k     ^            .    ^  k 

V.  --^min  (V.j=Zva'  -1-0.  ,(L-Zla')  -  max  {min  (^  .   -/^ . )  ( 1 .  )  (a  .  (-1) 

I  ,  J     ,  r  r    jfl     ■,  r  r  ,  ^  j  +  1   i   i    i 
-^  keo.        1                1  k€0  .  i>l 

J  J 

(10) 

For  the  discovery  of  a  better  feasible  solution,  then,  it  is 
necessary  that  V .  at  stage  j  exceed  the  value  of  the  best  feasible 
solution  discovered  so  far. 

To  put  (10)  in  a  more  preferable  form  for  implementation,  let 

w.,  =  (a. +1)1.,  W.,  =  min       {w.,  },  and  E  .,  =  min 
Lk      1     1    jk    .  .         ik        Jk    .  .  , 

{i/d.>a  )  {i/d.>a  1 

11  11 

\  {fi .      -Cf.)  (1.)  (a^+l)  )    =  min  {  (0  .       -0   )w.,   1.      Note   that    in    the 

ji-li         1         1  ..,  j+liik 

{i/d.>a    ) 
1      1 

definition  of  E .,  that  the  range  of  i  has  been  changed  from  i  >  j 

jk 

in  (9)  and  (10)  to  i  >  j  -i-  1 .   This  is  done  because  if  constraint 

)^ 
a.  >  a.  +  1  can  be  satisfied  with  a  feasible  choice  of  a .  ,  then 

II  j+1 

min    (J?.       -(2(.)  (1.)  (a^    f    1)    =-   0    since    (0.    ,    -   C^ . )     -   0    for    i   -    j  +  1, 
^  J+1      111  J+1  1 


49- 


and  hence  the  computation  of  E    is  of  no  value.   Upon  substitution. 


J  _    J 

V.  =  Zv  a'  +0^.  ,  (L  -  Zl  a')  -  max        {E.,  }         (11) 


we  then  have, 

^=Zva'  +0^.   fL-Zla')  -  max        {E.  1 

J    1  ^  ^     J^^      1  '    ^  kcQ.         J^ 

J    k 
a  .  ,  <  a  .  , 

j+1-  j+1 

J 

The  more  stringent  bound  (11)  can  then  replace  that  of  IZv  a'  +  0.      - 

r  r     J  +  1 

^    J 

(L  -  Zl  a')  j  employed  in  step  (vi)  of  the  algorithm. 
^  r  r 

Besides  this  possibility  it  may  be  possible  to  improve 

efficiency  through  use  of  the  following  test  for  feasibility: 

j 

If  max   (W .-  }  >  (L  -  Zl  a' )  no  feasible  solution     (12) 

keQ,    -•  1 

J 

with  a,  =  a'   a^  ^  a'   ...,  a.  =  a '.  exists. 
1     12     2      '   J     j 

This  follows  directly  from  the  definition  of  W .,  ,  the  smallest 

length  required  to  satisfy  the  kth  constraint  if  it  has  not  been 

satisfied  with  a'.,  i  <  i. 

1    — 

It  is  noted  that  in  all  cases  it  is  sufficient  to  compute  W., 

jk 

and  E .,  for  all  j  just  once.   However,  as  L  decreases  with  successive 
jk  ' 

knapsack  problems  it  may  be  desirable  to  re-evaluate  these  values 

since  with  a  smaller  L  the  effective  value  of  d.  may  be  decreased 

1 

for  one  or  more  i,  thus  increasing  some  of  the  values  W.,  and  E 

Jk      Jk 
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As  an  illustration,  let  us  again  consider  the  example  in 

Appendix  A  and  let  us  assume  that  as  a  consequence  of  Theorem  3 

the  parent  A   =  (2,  1,  0,  0)  and  all  feasible  descendents  A"  have 

been  determined.   Assume  also  that  the  feasible,  nondominated  set 

of  base  solutions  has  been  determined,  (P' )  =  ( P, ,  P, ) .   The 

largest  remaining  unevaluated  length  L  is  therefore  13  which  has 

an  upper  value  U(13)  =  13.   As  determined  earlier,  d   =  1,  d   =  5, 

and  d   =  2.    Since  L'  =  32  we  have  w(13)  =  0,   With  these  limits 

the  constraint  for  k  =  1  cannot  be  satisfied  with  either  a,  or  a„. 

1      2 

Therefore  we  have  the  following  values: 


1 

w . 

1 

w. 

— L 

^il 

0 

- 

3 

3/2 

1 

18 

3 

2/5 

2 

6 

3 

3/10 

3 

6 

3 

- 

4 

6 

3 

. 

Employing  the  combinatorial  programming  algorithm  with  the 
suggested  modifications,  we  begin  with  a'  =  -^L/l  )>   =   <'l3/6^  =    2. 
Since  V   in  (10)  exceeds  0  we  next  make  the  test  in  (11) .   Since 
Q  =  (1)  and  W    =  3  >  1  there  can  exist  no  feasible  solution  with 
a'  =  2.   Therefore,  we  decrement  a'  to  get  a'  =  1.   Again  V   in  (10) 
exceeds  0  and  again  we  make  the  test  in  (11)  .   This  time  (L  -  l-,^!) 
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7  >W   .   We  therefore  set  a'  =  min   [  {13-6)/3/,  l'  =  1. 


Now 


V   in  (10)  exceeds  0  and  in  (11),  (L  -  la'  -  l„a')  =  4  >W   . 

Next,  a'  =  min  L^t/  >  5j  -  0,  leaving  both  (10)  and  (11)  satisfied. 

r  /  4      ; 
Hence  we  try  a'  =  min  i.\"r/  ,  2J  =  2  which  satisfies  the  constraint 

imposed  by  A   and  gives  a  solution  value  of  10.   We  thus  save  A  = 

(1,  1,  0,  2)  as  the  best  so  far. 

Now  we  backtrack  to  j  =  2  and  set  a'  =  0.   Since  in  (10)  V  - 
10  r-  >  10  we  set  a'  =  ((13-6) /b)    =  1.   In  (10)  we  now  have  (6  +  3)  + 
1/2(13  -  11)  I  10;  therefore  we  backtrack,  setting  a'  =  0.   Then, 
a'  =  <((13-6)/2;  =  3,  yielding  the  value  V  =  9.   Since  V  <  10  we 
backtrack  to  j  =  1  and  set  a'  =  0.   Now  in  (10)  we  have  (0  +  2/3(13) 
-  3/2  <  10.   Hence  the  solution  A  -  (1,  1,  0,  2)  with  value  v  =  10 
and  length  L  =  13  is  optimal  for  this  constrained  knapsack  problem. 

Referring  to  the  set  [p^'  }  we  find  that  A  is  an  extension  of 
P   =  (0,  0,  0,  1) .   We  thus  generate  the  new  previously  ungenerated 
descendents  (1,  1,  0,  2),  (1,  1,  0,  1),  (1,  0,  0,  2),  (1,  0,  0.  1), 
(0,  1,  0,  2),  (0,  1,  0,  1),  (0,  0,  0,  2)  and  (0,  0,  0,  1)  and 
evaluate  each,  getting  V(13)  -  10,  V(ll)  =  9,  V(10)  =  8,  V(8)  = 
7,  V{7)  =  4,  V(5)  =  3,  V(4)  =  2  and  V(2)  =  1.   With  these  values 
it  follows  that  F(13)  =  12,  F(ll)  =  9,  F(10)  =  8,  F(8)  =  7, 
F(7)  =  6,,F(5)  =  3,  F(4)  -  2,  and  F(2)  =  1.   Since  F(l)  -  0, 
evaluation  is  complete. 
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In  conclusion  it  is  noted  that  another  possibility  for  solving 

the  constrained  knapsack  problem  defined  in  (8)  is  to  find  for 

each  nondominated  base  solution  P   an  optimal  extension  (P   +  A*) 

— q  -Tq   -T5 

such  that  L{P   +  A*)  <  L,  and  then  select  that  for  which 
-nq    -^   - 

V(P   +  A*)  is  maximum.   In  each  nondominated  case  where  B(L  -  1  )  jt 

-^     -q  q 

U(L  -  1  )  an  optimal  extension  can  be  readily  determined,  for 

q 

instance,  by  first  applying  the  algorithm  in  Section  HI  to  the 
knapsack  problem  with  length  L  =  L  -  1  .   In  each  such  case  the 
value  F(L  -  1  )  thus  becomes  determined  together  with  all  un- 

q 

evaluated  descendents  of  A*  --  in  addition  to  those  values  which 
eventually  become  determined  through  use  of  Theorem  13.   The 
potential  shortcoming  of  this  approach,  however,  is  that  it  may 
entail  explicit  solution  of  knapsack  problems  whose  value  would 
otherwise  become  evaluated  more  efficiently  as  descendents  of  a 
parent  solution. 
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V.   The  k-staqe  Knapsack  Problem 

As  was  discussed  in  the  introduction,  when  k  jc  2  the  knapsack 
problem  for  k-stage  guillotine  cutting  is  solved  by  solving  one  or 
more  one-dimensional  knapsack  problems.   For  k  >  2  however  it  is 
necessary  to  first  evaluate  (k  -  2)  two-dimensional  knapsack 
functions  F{W,  L)  the  results  of  which  then  define  a  2-stage 
problem.   In  this  section  we  consider  the  evaluation  of  F(W,  L) 
for  the  k-stage  problem  when  k  >  2. 

To  begin  let  us  consider  explicitly  the  knapsack  problem  at 

stage  k.   Let  the  stock  size  be  W     x  L     and  let  the  requirement 

max     max 

sizes  be  w.  x  1.  with  value  v.,  i  =  1,  2,  ...,  m.   For  specificity 
let  us  suppose  that  cutting  at  the  k    stage  is  performed  length- 
wise so  that  we  need  consider  strips  of  widths  w   >  ^^  >  •••  >  ^^.  > 
t  <  m,  where  for  each  i>w.  =  w.  for  some  j.   And  finally,  suppose 
that  inexact  cutting  is  permissable  so  that  in  a  strip  of  width  w 

all  sizes  w.  x  1.  with  w,  <  w  are  allowable.   With  these  assumptions 
1     1       1  — 

the  knapsack  problem  at  stage  k  is  defined  as  follows:  given  m 
items  with  sizes  w.  x  1.  and  values  v.,  i  =  1,  2,  ...,  m  determine: 


F(W,  l)  -   maximum      Zv . a . 

( a  .  /w .  <  W  )   i 
11  — 

Subject  to:   Z  a.  1.  <-  L  ( 1 .  a) 

^11- 

and   a.  >  0,  integer   all  i 

for  all  L,  0  <  I  V  L    ,  and  for  each  W=w  .,  j==l,2,....t. 
'    —   —  max'  J 
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To  solve  problem  (l.a)  we  can  proceed  in  a  manner  similar  to 

that  employed  in  earlier  sections  for  the  one-dimensional  problem. 

We  begin  with  the  width  w   and,  starting  with  L    .evaluate  in  order 

■L  max 

of  decreasing  length  L  the  values  F(w  ,  L) ,  0  <  L  <  L    .   We  then 

1        ~   ~  max 

proceed  in  turn  to  widths  w  ,w  , ,..,  and  w  ,  in  each  case  evaluating 
F{w  .l)  for  all  L  in  order  of  decreasing  length.   As  in  the  one- 
dimensional  problem  the  attempt  is  made  throughout  problem-solving 
to  determine  the  value  F(W,L)  of  an  unevaluated  size  WxL  first  by 
direct  means,  by  bounding  considerations^ and/or  by  the  use  of  base 
solutions.   When  such  attempts  fail  a  knapsack  problem  akin  either 
to  that  treated  in  Section  III  or  to  that  in  Section  IV  is  then 
solved  and  the  value  of  F(W,L)  thereby  determined.   Should  a 
parent  solution  A  be  determined  in  the  process  all  previously 

ungenerated  decendents  A'  are  determined  and  evaluated,  and  all 

— s 

/  ,-■ 

other  values  F(W,L)  which  can  be  deduced  from  A   and  its  descendents 

are  determined.   The  procedure  then  continues  on  with  the  largest 
unevaluated  length  for  the  largest  unevaluated  strip  width. 

Within  this  general  framework  some  of  the  results  of  the 
earlier  sections  can  be  applied  without  change  while  others  require 
modification  or  extension.   Before  further  considering  procedures 
for  solving  the  problem,  therefore,  we  first  summarize  the  modifi- 
cations required.   These  are  stated  without  proof  since  they  follow 
immediately  from  the  original  proof  with  appropriate  modification. 
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Throughout  this  section  we  will  denote  by  L(A)  the  length 

Z  a,  1.  of  a  solution  A  =  (a  .a^,...,a  ),by  V(A)  its  value 
j_li  ~"12      m       ~ 

X  a.  V. ,  and  by  W(A)  its  width   max       (w.) .   Similarly  we  will 
i   ^   ^  ~  {i/a.  >  Oj   1 

k    i       k 
denote  by  i   the  length  ::  a.  1   of  a  base  solution  P,  =(p,  ,p^  ,...,p   ), 
k  ill  ""k    12       m 

]^ 
by  7      its  value  Z  p.  v.,  and  by  a   its  width    max       (w.) .   We 
^  i   ^   ^  ^  (i/p.k  >  0]    ^ 

1 

will  assume  that  evaluation  of  F(W,L)  proceeds  from  strip  to  strip 
in  the  order  w   >  w   >...>  w   and  that  for  a  given  strip  in  the 
order  of  decreasing  length. 

Turning  first  to  equations  used  in  earlier  sections,  the  fol- 
lowing modifications  are  required  for  the  present  problem: 

g^  (w  ,y)  =      max  [g^    (w  ,x))  (2. a) 

0  <  X  <  y 
0  <  s  <  n 

g^(Wj,y)  =       min    [g^Cw  x),  J2<^(w  )-y]  (3. a) 

X  >  y 

s  >  '^ 

B(w.,L)=max  [  (nv  +g   (w .  ,v)  )  ,  B(w     L)]  <F(w.,l)  <   (4. a) 
J  1   n    J  J  *-!  J 

min  [(nv  +g"(<7.,y))  •,  u(w.  ^,L)]  =U(w  ,L) 
1   n   J  j-1  J 

where  L  =  nl  +y,  and  v.  and  1.  refer  to  the  size 
1         1      1 

w.xl.  w,  <  w.,  for  which  (t) ,  (w  )  is  maximum. 
1   1   1  -  J  1   J 

For  equation  (6)  two  different  applications  can  be  distinguished 

for  the  present  problem.   In  one,  if  there  exists  a  set  of  nonnegative 
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integers  {e.  )  satisfying  (6)  in  which  e  =0  for  all  k  such  that 

w   <  w   then  size  w.xl.  can  be  elmintated  from  consideration 
j     k  11 

throughout  the  evaluation  of  F(W,L)  for  all  W  and  L.   In  the 
other,  if  there  exists  a  set  (e  )  satisfying  (5)  in  which  e  =0 

K,  K 

for  all  k  such  that  w,  <  w  and  w.  <  w,  then  size  w.xl.  can  be 

k  —        J  ~"  11 

eliminated  throughout  the  evaluation  of   F(w,L)  for  all  L. 

Turning  to  the  theorems  of  the  earlier  sections  the  relevant 
modifications  for  the  present  problem  are  as  follows: 
Theorem  l.a:    If  A  is  an  optimal  solution  to  problem  (l.a)  with 

knapsack  size  WxL  then  A'  is  an  optimal  solution  for 

A 
all  knapsacks  of  size  WxL  for  which  W(A')  <  W  <  W 

A 

and  L=L(A'),  for  every  descendent  A'  of  A. 

Theorem  2 .a:    If  A  is  an  optimal  solution  to  problem  (l.a)  with 

knapsack  size  W^L   then  A  is  an  optimal  solution  for 

A  A  A 

all  knapsacks  of  size  WxL  for  which  W(A)  <  W  <  W 

A 

and  L(A)  <  L  <  L. 

Theorem  3. a:    Let  all  sizes  w.xl.  with  w.  <  w  be  ordered  so  that 

11       1  ~ 


f,  >  i?^  >  .  .  .  >  Of    ,  ,    where  Of .    =  v  .  /I . 
1  -  ^^2  -     -  '^m'  '        '^i     1   1 


Then  solu- 


tion A*  =  (^1*'  ^-y* '    *^'  ''->    0)  ^"^  ^^^  °f  ^^^ 
descendents  A'  are  optimal  for  knapsacks  of  size 

A  A  A  A 

WxL,  W(A')  <  W  <  w  and  L=L(A'),  where 


'=  <H/^2-  O' 


sl*=  -^i./i.-  ^>,'r'-^o 


Theorem  4. a:    See  modifications  in  Theorem  3. a, 


Theorem  5 , 
Theorem  6. 
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No  modification  required. 
Applies  independently  to  problem  defined  for  each 


width  w.,  j=l,2,  ...,  t. 

Theorem  7.      Applies  independently  to  problem  defined  for  each 
width  w.,  j=l,2,...,  t. 

Theorem  8.      Applies  independently  to  problem  defined  for  each 
width  w.,  j=l,2,  -..,  t. 

Theorem  9.      Applies  independently  to  problem  defined  for  each 
width  w.,  j^l,2,...,  t. 

Theorem  10.     No  modification  required. 


Theorem  11. a:   Let  P   be  any  base  solution  for  the  set  D   in  the 

-k  s 

evaluation  of  F(W,L)  and  let  .^^  ,a,   and  y       be  its 

JC   K         K, 

length,  width  and  value.   Let  w  be  the  largest 

width  whose  evaluation  is  incomplete,  and  let  L  be  the 

largest  unevaluated  length  for  this  width.   Then: 

(i)  Base  P,  can  be  eliminated  from  consideration  m  all 
-k 

subsequent  evaluation  of  F(W,L)  when  any  of  the 
following  conditions  ar^:  ^=»tisfied: 

(a)  a   >  w 

_  I 

(b)  a   =  w  and  i      >   L 

K  K 

(c)  a,=  w   and  7   <  F  (w,  L) 

K  K  K 

(d)  a,  =  w  and  7  ,  <  B(w,  £^  ) 

k  k         k 
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(e)  o.        >   a. ,    Jt',     >   £  ■    and  / ,     <  7  ■    for   any   other   base 

K      J     K      J         K      J 

solution  P  .  in  the  set  5  . 
-J  s 

(ii)  Base  P^^  can  be  eliminated  from  consideration 

throughout  the  evaluation  of  F(w,L)  for  all 

L<L,  W-w,  ifci   <w  and  i   >  L. 

ri  K 


Theorem  12. a; 


Let  A,,  A^,  ..-,  A.,  ....  A  be  solutions  to  knap- 
-1—2        J       -s 

sack  problems  (l.a)  where  A.  is  optimal  for  a 

knapsack  of  size  W(A.)  x  L(A.),  and  let  D  denote 

-J       -J  s 

the  set  of  descendents  for  A,,  A^,  ....  and  A  . 

—1  ~2  — s 

Let  B(w,L)  and  U(w,  L)  be  bounds  on  F(w,L)  as 

determined  according  to  (4. a)  on  the  basis  of  all 

,  s  , 
solutions  in  the  set  D  .   Let  IP  }  be  the  subset 

s 

of  base  solutions  which  are  feasible  and  nondomi- 

nated  for  width  w  and  length  L.   Then: 

(i) ,  (ii) ,  (iii) ,  (iv) .   Same  as  Theorem  12  with 

the  one-dimensional  bounds 
replaced  by  the  correspond- 
ing two-dimensional  bounds, 
e.g.   B(L)  by  B(w,  L) . 


Theorem  13. a: 


Let  A^,  A^, 


,  A., 


,  A   ,  be  solutions  to 
— s-1 


knapsack  problems  (l.a)  in  which  A.  is  optimal  among 

solutions  in  the  set  D    =  J^  S  ,  where  S   is  the 

J  — 1    K— Ik         k 

set  of  solutions  consisting  of  A^  and  its  descendents 
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Let  B(t^,L)  denote  the  largest  value   E  v.  a.  attainable 

1   ^   ^ 

among  solutions  in  the  set  D     with  length  L  <  L  and 

s-1 

width  W  <  W.   And  let  A  be  an  optimal  solution  in  D 

—  s^  s-1 

for  the  largest  unevaluated  length  £  of  width  w.   Then: 
(i)   FCf^,^)^  max  [B(^,L)  ,  V(A  )]  for  all  sizes  Wxf, 
W(A  )  <  ^  <  W  and  L{A  )  <  L  <  £. 

_g     _      _  _g     _      _ 

(li)  F(^,f)=  B(<^,L)  for  all  sizes  ^xL  such  that 
B(^,L)  >  V  (A  )  ,   vi  <  w,  L  <  L. 

(iii)   F(W,L')=  max  [b(W,L')  V{A')]  for  all  descendents 

A'   of  A  ,  for  all  widths  W(A')  <  W  -^  w. 
—  s     — s  — s   —   — 

Returning  at  this  point  to  the  discussion  of  the  overall 
problem-solving  procedure  for  the  two-dimensional  problem,  there 
are  numerous  ways  of  synthesizing  the  results  into  an  algorithm, 
as  was  the  case  in  the  one-dimensional  problem.   As  one  possibility 
Figure  5  shows  the  flow  chart  of  an  algorithm  which  employs  the 
procedure  of  Section  Hi    for  coping  with  each  one-dimensional 
problem  requiring  explicit  consideration.   For  illustration,  we  use 
the  algorithm  to  solve  the  sample  problem  given  in  Appendix  B. 

Beginning  at  block  1  in  Figure  5  it  is  determined  that  w=6 , 
[pS  I  p s  J  ^  (p   jp^j  and^^,  upon  identifying  the  set  of  lengths 


19.   In  the  partitioned  representation  IP^  |  £^ i  of  the  set  of  bases 
P^  the  subset  P^  denotes  these  bases  that  must  be  considered 
for  the  present  width  w  and  P_^  those  which  can  be  eliminated 
during  consideration  of  width  v7  but  must  be  reconsidered  for 
widths  smaller  than  w.   The  set  ^    is  the  null  set. 
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{1  .1„,1^,1.  },  that  6=h-l,  where  P=  (0,0,0,0).   Since  min ( 1 . ) -2 , 
F(6,l)-0. 

Proceeding,  it  is  determined  in  block  9  that  the  variables 
are  presently  in  the  desired  order,  and  upon  application  of 
Theorem  3. a.  that  A=(2, 1,0,0),  which  is  an  extension  of  P  . 
Generating  descendents  in  block  10  there  results  the  solutions 
^1  >  ^5   A    and  A   with  the  values,  lengths  and  widths  as  shown 
in  TaDle  B.l.   Employing  the  fact  in  Theorem  l.a.  that  each 
descendent  A'  is  optimal  for  all  widths  W(A' )  <  w  <  w  for  length 
L (A' ) ,  there  results  the  values  F(6,3),  F(5,3),  F(6,6),  F(5,6), 
F(3,6),  F(6,9),  F(5,9),  F(6,12),  F(5,12)  and  F(3,12).   These 
values  are  shown  in  Table  B.2  where  the  2  in  the  upper  left  corner 
of  the  cells  signifies  that  the  value  is  in  the  second  group  of 
values  F(W,L)  determined.   The  entry  corresponding  to  F(W,L)  in 
Table  B.3  identifies  a  solution  in  Table  B.l  yielding  value 
F(W,L) .   Resuming  with  the  algorithm,  formation  of  vector  H=(3,2,l,l) 
completes  the  processing  in  block  10. 

Proceeding  to  blocks  14  and  15^ £=13  for  which  it  is  determined 
that  B(6,13)=12  and  U(5,13)=13.   Since  the  bounds  are  unequal  the 
algorithm  proceeds  to  block  18  at  which  point  it  is  determined  that 

(ps+1  |p  +  l)  =  (P  ,P  ,P  ,P   |pf},  where  the  base  solutions  P  ,P  ,P   and 
P   are  as  shown  in  Table  B.4.   Applying  Theorem  11. a  in  block  20  it 
is  found  that  P      can  be  eliminated  completely  from  the  evaluation 
of  F(W,L)  and  P_     can  be  eliminated  at  least  from  evaluation  with  w=6. 
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Start 

__L_ 


Order  widths  w  >w„>...>w  ,  set  w . -w, . 
12       n        J   1 

Set  IP  J  P^J  -  iP^  I  t?.',  P^=(0,0,-..,0) 


3_ 


2. 


Identify   set   of   sizes    {w.xljfor  which  w.<w,. 

11  i~  J 

Determine  largest  common  factor  6  of  set  {1.  ) 

1 


and  h  of  corresponding  set  (v. 
F(w.,L)=0  for  all  0<   L  <  min 


Set 


Are  all  lengths  L  for  width  w.  evaluated? 

J 


Yes 


f 


O 


or 


Set  F(w,L)=  B(w,L)  f 
all  unevaluated  lengths  £ 
Record  all  solutions 


_L2. 


I 


No 


Determine  largest  unevaluated  length  £ 


I 


Has  intersection  of  H  with  set  (P^|p^i 

been  determined? 

yes                  No 

6. 

Form  intersection  of  H  and 

the  set  {P  ]„    .    (Th.  10.) 

— S  '^ 
Synthesize  with  remaining 

bases  in  the  set  {P  1  P  ). 

-s'  s 

t   7. 

Reduce  set  [P   P  )  (Th.  11. a) 
s   s 

Index  w  to  next  width  wj 


I 


-Li 


w.=0  ? 
J 


No 


Yes 
Terminate 


T 


Is  subset  £   empty?! 


Yes| 


No 


Order  variables  such  that  pT^  >  (2f^>...>  ^ 
Determine  directly  parent  solution  ^ 
(Th.3a  or  4a> 
Identify  subset  {P^ 
A  is  an  extension 


)„  of  bases  of  which 


2. 


10, 


Generate  'Th.lO)  and  evaluate 
(Th.  l.a  and  2. a)  all  ungenerated 
descendents  of  A,  updating  F(w,L). 
Record  all  solutions.  Form  vector  H  for  A 


J 


Figure  5.   Algorithm  for  evaluating  knapsack  function  at  stage  k. 
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1 


•  14. 

All  lengths  L  for  width  w  evaluated? 


Yes 


No 


15, 


Determine  largest  unevaluated  length  £ 
Evaluate  B(w,L)  and  W(vJ,f).   (eq.  4. a) 


16. 


B(w,L)=  U(W,  £)? 


No 


Yes  ■ 


"17. 


Has  intersection  of 
H  and  setlPSJpS)  been 
determined . 


No 

18. 


Yes 


Form  intersection  of  H  and  the 
set  {P  }  .   (Th.  10) .   Synthesize 
wtth  remaining  bases  in  set 

— s  •  — s 


19. 


Set  F(W,f ) =  B(w,C) , 
Record  all  solutions. 


20, 


Reduce  set  of  bases  (Th.  11. a) 

*.  ■;;s  +  i  I  =s+I  , 
to  get  tP      P    )  . 


.21^ 


Is  subset  (P^^-*-  1  empty? 


Yes 


(£>-• 


No 


22, 


Evaluate  B(w,L)  and  U(w,C) .  {Th.  12. a) 


I 


23. 


V    (w,f)   <   B  (w,f,) 


No 


Yes 


(2) 


Figure  5.  Continued 
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© 


24. 


For  any  base  P   does  there  exist 

"^     _ 
extension(s)   (P   +  A  )  such  that 

V(P  +A  )  -  U  (w,L)? 


J^ 


Yes 


Define  parent  solution (s) 
A  -  (P   +  A  )  . 

-   -^  ^q 

Set  (pS  }   =  (p  j. 
-   E     ^q 


No 


_2^^ 


Set  V  =  h  +  max  [B(L) ,B(L) ] 
and  V^  =  min  [U(L),  U  (L) ] . 
Solve  knapsack  problem  (Section  II) 


© 


21. 


Does  a  feasible  solution  A  exist? 


Yes 


No 


28 


Determine  set  of  uases 

3 

iP  A   °f  which  A  is  an 
extension 


Set  F(w,L)  =  max   [B(w,L) ,  B(w,l 
Record  all  solutions 


(b 


© 


Figure  5 .   Continued 
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— s+1  I  =s+l 
Therefore  (p    j  P    )  reduces  to  the  set  iP^.P,  I  £ -,  ^  •   Since 

-s+1  -  - 

{P    )  is  not  empty  the  bounds  B(6,13)=ll  and  U(6,13)=13  are 

evaluated  from  which  it  follows  that  U(6,13)  >  B(6,13).   Therefore 

the  algorithm  proceeds  to  block  24  and  then  to  block  26.   At  this 

point  the  algorithm  of  Sectionlll  is  applied  with  L=13  and 

V  =V  =13.   The  outcome  is  that  no  feasible  solution  exists  for 

L=13  and  V=13,  and  hence  F (6, 13) =F{6, 12) =12 . 

Returning  to  block  14  we  now  have  L=ll  for  which  it  is 

determined  that  B(6,ll)=8  and  U(5,ll)=12.   Since  the  intersection 

of  H   and  (P.  |  P.  )  has  been  determined  and  no  further  reduction  is 

possible  for  L^^ll  the  algorithm  proceeds  to  block  22  and  evaluates 

B(6, 11) =U(6, 11) =9.   Since  U(6,ll)  >  B(6,ll)  we  next  go  to  block 

24  where  it  is  learned  from  Theorem  12. a  that  V(P  +A   ) =V(P  +A  ) = 

U(6,ll)  so  that  both  the  extension  (P.,+A,  ,)=A_  and  {P  ^+A^)  =A^    is 

—3  —11   —7       —4  —5   —4 

optimal  for  F(6,ll).   The  set  {P  )   thus  becomes  (P-,,P.  }.   Generating 

E  3   4 

descendents  of  both  in  block  10  and  evaluating  the  resulting 
solutions  there  results  the  11  values  of  F(W,L)  signified  by  a 
4   in  Table  B.2.   Recording  these  solutions  and  forming  the 
vectors  H=(2,2,l,2)  and  H=2, 1,2,1),  the  algorithm  proceeds  to 
block  14. 

With  L=10  the  bounds  B(6,10)=8  and  U{6,10)=9  are  evaluated 
and  the  algorithm  proceeds  to  block  18.   Determining  the  inter- 
section of  H=(2,2,l,2)  with  {P.-,P.  |  P  )  the  result  is  set 
(P3>£5^P^'E7>Pq  I  ^2  ^  ^"<^  H=(2, 1,2,1)  with  the  latter  the  result 
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is  set  fP5'Pf,'P7'P8'^'-10'-ll'-12   -2^  which  in  block  17  reduces 

to  the  set  (P  I  P_,P^}.   Evaluating  B ( 6, 10) -U(6, 10) =8=B(6, 10)  we 
o  '   2   b 

proceed  to  block  19  and  set  F(6, 10) =F(6, 9) . 

Returning  to  block  14  and  resuming  with  L=7  the  bounds 
3(6, 7) =U(6, 7) =6  are  determined  with  the  result  F(6, 7) =F (6 , 6) . 
Again  the  algorithm  returns  to  block  14.   This  time  L=4  for  which 
3(6,4) =2=U(6,4)  so  that  F(6, 4) =F(6, 3) .   At  this  point  there  remains 
no  unevaluated  length  so  we  proceed  to  block  12,  set  w=5,  and 
continue  to  block  2, 

At  block  2  the  set  of  sizes  (1,1,1)  is  identified  and  the 

values  5=h=l  and  F(5,l)=0  determined.   In  block  4  it  is  found  that 

L=13  and  in  block  7  that  the  set  (P  j  can  be  reduced  to  (P_o  1  (? } . 

o 

Forming  solution  A  in  block  9  it  is  found  not  to  be  an  extension 

of  P_     so  that  the  algorithm  proceeds  to  block  15  where  it  is 
8 

determined  that  3( 5 , 13) =U( 5 , 13) =12 .   Setting  F( 5, 13) =F(5, 12)  it 

is  then  found,  in  turn,  that  3(5, 10) =U(5, 10) ,  3(5, 7) =U(5, 7)  and 

3(5,4) =U(5, 4)  (after  each  of  which  the  algorithm  sets  F(5,L)= 

B(5,L))  to  complete  evaluation  for  w=5. 

Continuing  from  block  12  with  w=3  the  algorithm  identifies 

the  set  [1,1),  determines  the  values  6=2,  h=l  and  L=10,  and 

ascertains  that  no  reduction  in  (P  )  is  possible.   Ordering  the 

variables  in  block  9  and  applying  Theorem  3. a  the  result  is 

solution  A=(2,0,0,2)  which  is  an  extension  of  P  .   Proceeding 

o 
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to  block  10  the  descendents  A^^^^  and  A   are  generated  and  the 

evaluations  F(3,10),  F(3,4)  and  F(2,4)  obtained,  as  shown  in 

Table  B.2.   Forming  H=(3,l,l,3)  the  algorithm  returns  to  block  14. 

At  this  point  evaluation  for  w=3  is  complete  and  the  algorithm 

sets  w=2,  identifies  the  set  of  sizes  (l.),  and  determines  the 

4 

values  5  =  2,  h=l  and  L=^12.   Forming  the  intersection  of  H=(3,l,l,3) 

and  (P  )  there  results  the  set  (P,  ^  ,P,  . ,  P,  ^  ,P,  ^  I  0')  which  becomes 
—  —13  ~14  —15  ~16  ' 

upon  reduction  iP.-,  f-  !  ^^-      The  procedure  now  determines  directly 
the  solution  A=(0,0,0,6)  which  is  found  to  be  an  extension  of 

P  ^ ,   Generating  and  evaluating  descendents  there  results  the 

—16 

values  as  shown  in  Table  B.2.   Forming  H= (1,1, 1,7)  the  algorithm 
goes  to  block  14  and,  upon  finding  all  lengths  evaluated,  continues 
to  blocks  12  and  13  where  it  terminates. 

An  alternative  to  the  algorithm  in  Figure  5  results  by 
substituting  the  search  procedure  of  Section  iv  for  that  of 
Section  III,  thereby  replacing  the  evaluation  scheme  based  on  the 
controlled  search  of  ranges  of  the  value  F(W,L)  with  a  scheme 
based  on  the  controlled  generation  of  parent  solutions.   This  is 
accomplished  with  the  following  modifications  in  Figure  5: 

Block  10:   Evaluate  solutions  on  the  basis  of  Theorem 

13. a   as  well  as  on  that  of  Theorems  l.a  and  2. a. 
Block  26:   Replace  content  of  block  by  simply, 

"Solve  knapsack  problem  (Section  IV  )", 
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Block  29:   Replace  content  of  block  by  simply,  "Set 
F{w,L)  ^■^B(w,l)  for  all  unevaluated  lengths 
L   for  width  w. 
Record  all  solutions." 
With  this  algorithm  problem-solving  proceeds  quite  differently 
for  the  example  xn  Appendix  B.   As  can  be  seen  from  the  numbers 
in  the  upper  right  corner  of  the  cells  in  Table  B.2  the  evaluation 
of  F(W,L)  is  now  obtained  in  five  groups.   In  summary,  these  occur 
as  follows.   For  w=:6,  mind.  1^2  so  that  F(6,l)=0.   Application  of 
Theorem  3. a  then  yields  parent  solution  A={2,lj0,0)  from  which  is 
generated  descendents  A  ,A  ,A   and  A    (see  Table  B.l)  whose 
evaluation  results  in  the  entries  of  group  2  in  Table  B.2.   At 
this  point  L=13  and  the  reduced  set  of  base  solutions  is  ( P.^ , 
P  j  P „ )  (see  Table  B.4) .   In  block  26  solution  of  the  knapsack 
problem  by  the  procedure  of  Section  IV  yields  parent  solution  A 
which,  being  an  extension  of  £  ,  results  in  the  generation  of 
descendents  A^ , A^, A^ , A^p , A^g , A^^ , A^3 ,  and  A^^.   Evaluating  these 
solutions  in  block  10  there  results  the  entries  of  group  3  in 
Table  B.2  which  completes  the  evaluation  for  w=6.   Proceeding  to 
w=5  It  is  found  that  min  (1. )-2  so  that  F(5,l)=0.   With  the 
evaluation  of  w=5  complete  the  algorithm  proceeds  to  w=3  which  is 

also  complete  and  hence  to  w  2  for  which  it  is  determined  that  L=12 

g 
Forming  the  intersection  of  H  and  (P  )  there  results  the  set 

{P^,P^,P^  ,P^,P,  ^  I  P^  i  which  reduces  to  the  set  iP,,-l  ^\.       Finally, 
—3  —5  —6  —7  —16  I  —2  —16' 
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determining  in  block  9  the  parent  solution  A= (0,0, 0,6)  and  generating 
descendents,  A   ,A   , A    and  A   ,  there  results  the  entries  in 
group  5  which  completes  the  evaluation. 

With  both  algorithms  discussed  for  the  two-dimensional  problem 
a  more  efficient  procedure  may  result  through  use  of  one  or  more 
dominance  tests  based  on  (6) .   For  example  in  block  1  of  Figure  5 
a  test  can  be  applied  to  each  size  (w.xl.)  to  try  to  eliminate  it 
during  the  evaluation  of  F(W,L)  completely.   Then  for  each  width 

w.  tests  can  be  applied  in  block  2  to  the  sizes  in  the  identified 

J 

set  {w.xl. }  to  try  to  eliminate  one  or  more  of  them  during  the 
11 

evaluation  for  width  w.,  all  sizes  thereby  eliminated  then  being 

reconsidered  for  width  w.  ,.   In  this  second  application  of  (6) 

j  +  1  ^^ 

there  is,  in  addition  to  the  advantages  associated  with  the 
elimination  of  dominated  sizes  mentioned  in  Sectionll,  a  savings 

in  the  generation  of  base  solutions.   For  if  size  w  xl   has  been 

20  _     _    '^   ^ 

dominated  in  all  sets  {w.xl. )  for  widths   w.  >  w,  then  it  can  be 

11  J     k 

shown  that  for  all  widths  w.  >  w,  size  w  xl   can  be  ignored  in 

J     k        q   q 

forming  vector  H  (block  10)  and  subsequently  in  determining  the 
intersection  of  H  and  the  set  {£  )  (blocks  6  and  10) ;  instead  it 
is  sufficient  to  simply  add  to  the  set  {P  )  at  the  beginning  of 


on         ' — ' ■ i" ■ • 

■^If  size  w.xl.  is  dominated  for  width  w,  ,  it  is  dominated  for  all 

widths  larger  than  w,  ,  . 

k-1 
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21  ~ 

the  evaluation    for  width  w   a  unit  base  solution  P  -0,0,... 0, 

1,0,...,0),  where  the  unit  element  occurs  in  the  position 

representing  size  w  xl  • 

Dominance  considerations  are  also  important  in  permitting  a 
more  compact  representation  in  some  problems,  thereby  making 
possible  considerable  economies  in  data  manipulation.   Since  these 
possibilities  tend  to  increase  as  problem-solving  progresses 
from  stage   k   to  stages  k-1,  k-2,  etc.,  let  us  consider  briefly 
at  this  point  the  problem  at  stage  k-1. 

Upon  completing  the  evaluation  of  the  knapsack  function 

F,  (W,L)  for  0  <  L  <  L     and  W=w . ,  i=l,2,...,t  at  stage  k  the 
k  —   —  max        J 

problem  at  stage  k-1  is  to  evaluate  the  function  F    (W,L)  for 

L  =  l,,l^.  .  .,,1   and  0  <  W  <  W    .   This  problem  is  identical  to 
12'      z       —   —  max 

that  at  stage  k  except  cutting  now  takes  place  widthwise.   The 

I      I 

sizes  w.xl.  for  stage  k-1  are  the  non-dominated  sizes  which  result 
11 

at  stage  k,  i.e.  the  sizes  w.xL  for  which: 

J 

F,  (w.,L)  >  F  fw.  ,  ,L)   and  F  fw.,L)  >  F(w.,I')   j- 2  ,  3  ,  .  .  ,  ,  t  ;0<  I  <  L 
kj        kj  +  1  kj  J  —  iOax 

(13) 

or      F,  (0,1.)  >  F,  (0,L' )  0  <  L  <  L 

k         k  max 

where  L'  is  the  largest  evaluated  length  of  the  same  width  that 
.s  smaller  than  L.   For  example  if  we  assume  Table  B.3  to  be  the 
function  F  (W,L)  for  stage  k  then  the  sizes  for  stage  (k-1)  are 

K. 


21ln  Figure  5  this  step  can  be  inserted  in  block  7  preceding  the 
reduction  step. 
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those  whose  value  in  the  Table  is  encircled.   With  the  sizes 

define^  in  (13)  we  can  now  proceed  to  solve  the  problem  at  stage 

(k-1)  using  any  of  the  algorithms  appropriate  for  stage  k. 

Returning  at  this  point  to  the  discussion  of  dominance 

considerations  it  is  noted  that  upon  application  of  dominance 

tests  in  block  2  the  14  sizes  in  the  example  will,  for  every 

length  1.,  be  reduced  so  that  at  most  3  sizes  appear  in  the 

identified  set  {w'.xl!  ).   Or,  to  state  it  more  generally,  if  among 

the   m   sizes  w'.xl!  there  are   t   different  widths  w,  ,w„,...,w^ 

11  1   2       t 

and  z  different  lengths  1  ,1  ,...,1   then  there  is  at  most   t 

nondominated  sizes  in  the  set  (w'.xl ;  }  for  any  length  1.-   Since 

11  J 

these  sizes  are  always  uniquely  defined  for  a  given  length  1. 

(i.e.  for  each  width  w,  the  size  in  the  set  is  the  size  w'.xl  I 

k  11 

with  W.  =w   and  the  largest  length  not  exceeding  1.)  it  is  therefore 
possible  throughout  problem-solving  to  represent  the  problem  in 
terms  of  vectors  H,£  and  A  having  only   t   elements  rather  than  m. 
This  can  result  in  considerable  economies  in  data  manipulation. 

To  conclude  we  consider  the  sample  problem  at  stage  (k-1) 
defined  by  the  nondominated  sizes  at  stage   k   in  Table  B.3.   The 

data  for  the  problem  is  given  in  Appendix  C.   Table  C.l  lists   the 

22 
complete  set  of  feasible  solution  vectors   A-(a  ,a  ,a  )  for  the 


2?  —   • 

a.  is  the  number  of  elements  of  width  w   m  solution  A. 
1  1  ~ 


-71- 

prob]em,  showing  that  with  the  compact  representation  there  are 
only  12  solution  vectors  even  though  there  are  14  sizes  in  the 
problem.   Table  C.2  shows  the  base  solutions  generated  in  solving 
the  problem  either'^-^  by  the  algorithm  employing  the  procedure  of 
Section  ILI  or  by  that  employing  the  procedure  of  Section   IV, 
Table  C.3  gives  the  optimal  values  F    (W,L)  which  result  at 

K  —  1 

cutting  stage  k-1  and  Table  C.4  identifies  a  solution  vector  A 
in  Table  C.l  which  will  yield  the  optimal  value. 

Thus,  for  example,  Table  C.3  indicates  that  a  sheet  arriving 
at  stage  (k-1)  of  size  8x11  can  be  cut  widthwise  at  stage  k-1  and 
the  resulting  pieces  cut  lengthwise  at  stage  k  in  a  manner  yielding 
a  value  of  F    (8, 11) =21.   According  to  Table  C.4  this  is 

accomplished  by  cutting  according  to  solution  vector  A^  at  stage 

— 5 

k-1,  where  according  to  Table  C.l   A^=( 1,2,0) .   Scanning  the  list 

5 

of  14  sizes  with  vector  A   and  length  11  it  is  found  that  solution 
A   implies   1   unit  of  size  2x10  and  2  units  of  size  3x10.   Pro- 
ceeding to  Table  B.3  it  is  seen  that  at  stage  k  the  unit  of  size 

2x10  will  be  cut  according  to  solution  A^„  in  Table  B.l  and  each 

^  —40 

of  the  units  of  size  3x10  according  to  solution  A  .   Therefore 

putting  these  results  together  it  follows  that  if  a  sheet  of  size 

8x11  is  cut  in  the  two  stages  according  to  a  pattern  such  as  that 
23For  this  problem  all  evaluations  F    {W,L)  are  actually  obtained 

K  1 

through  direct  solutions,  use  of  base  solutions, and  bounding 
considerations,  and  hence  the  procedures  of  Section iTT  or  IV 
are  never  employed. 


-72- 


in  Figure  6.  then  a  maximum  value  will  be  obtained 


8 


i 
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Figure  6.   An  optimal  cutting  pattern  for  stages 
(k-1)  and  k  for  a  sheet  of  size  8x11. 
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VI .  Concluding  Remarks 

In  the  preceding  sections  partitioning  algorithms  have  been 
discussed  for  evaluating  a  class  of  knapsack  functions  which  has 
been  described  m  the  context  of  k-stage  guillotine  cutting  of 
sheets  of  stock.   In  some  contexts  there  are  additional  attributes 
of  the  problem  to  be  considered  or  constraints  to  be  imposed 
besides  those  discussed  so  far.   In  conclusion  we  comment  briefly 
on  the  application  or  adaptation  of  the  partitioning  algorithms 
in  a  few  such  cases. 

At  the  one  extreme  there  are  problems  which  can  be  accommodated 

with  no  changes  in  the  algorithms.   This  is  the  case  for  the 

problem  mentioned  earlier  in  which  orientation  of  sizes  (lengthwise 

or  widthwise)  with  respect  to  the  stock  sheet  is  immaterial.   In 

this  case  one  simply  represents  each  rotatable  size  in  the  problem 

as  both  a  unit  of  size  w.xl.  and  a  unit  of  size  l.xw. ,  both  of 

11  11 

value  v.,  and  proceeds  with  the  algorithm  in  its  existing  form. 

At  the  other  extreme  are  variations  of  the  problem  which  can 
be  accommodated  only  with  considerable  modification  in  the 
algorithms.   This  is  the  case,  for  instance,  with  problems  having 
one  or  more  of  the  following  types  of  constraints  considered  by 
Gilmore  and  Gomory  [s]  :   a  constraint  on  the  maximum  number  of 
units  into  which  a  strip  can  be  chopped  or  strips  into  which  a 


-74- 


sheet  can  be  slit: 

?a.  <  K  (14) 

11  — 

a  limit  on  the  maximum  number  of  units  of  size  w.xl.  that  can  be 

1   1 

cut  from  a  strip  or  of  strips  of  width  w.  that  can  be  slit  from  a 

1 

sheet: 

a.  <  d .        i=l>  2, . . . ,m  (15) 

and  a  limit  on  the  number  of  different  sizes  that  can  be  obtained 
from  a  single  strip  or  number  of  different  strips  from  a  sheet: 

^5(a.)  <M  (16) 

where  6(a.)=l  if  a.  >  0  and   0   otherwise. 

As  in  the  case  of  dynamic  programming  approaches, the  modi- 
fication required  in  the  partitioning  algorithms  to  accommodate 
these  constraints  will  seemingly  result  in  an  increase  in  the 
problem-solving  effort  required  to  solve  the  problem.   In  the 
case  of  the  partitioning  algorithms,  use  of  the  underlying 
search  strategies,  the  generation  and  evaluation  of  descendents, 
the  use  of  base  solutions,  etc,  all  remain  appropriate  but 
significant  changes  must  be  made  in  many  of  the  details.   These 
changes  are  similar  for  all  three  types  of  constraints,  (14),  (15) 
and  (16),  and  are  summarized  below  for  a  problem  with  constraint 
( 14)  : 

F(W,L,K) =maximum       ?v . a . 

(a./w.  <  W)   ^  ^  ^ 
1   1  — 
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Subject  to:   2a .  1 .  <  L  (l.b) 

1  1  1  — 

Sa.  <  K 
11"" 

and         a.  >  0,  integer     all  i. 

A  principal  change  in  the  algorithms  is  brought  about  as  a 

consequence  of  the  change  in  the  optimality  of  descendents: 

Theorem  l.b:   If  A  is  an  optimal  solution  for  problem  (l.b) 

with  knapsack  size  WxL  and  limit  K  then  A'  is  an 

optimal  solution  with  value  F(W,L,K)  for  all 

knapsacks  with  W(A' )  £  W  <  W,  L=L(A')  and 

?a'.  ^  K  <  K-?a  +^a'.  ,    for  all  descendents  A'  of  A. 
11—   —   111  ~~" 

Since  descendent  A'  is  not  necessarily  optimal  for  limit  K  a 

procedural  choice  arises  between  solving  problems  (l.b.)  with  the 

limit  set  at  K  and, by  ignoring  constraint  (14),  solving  problem 

(l.a).   The  first  alternative  assures  that  the  value  F(W,L,K) 

itself  will  always  be  determined  but  yields  only  lower  bounds 

B(W(A' ) ,L(A' ) ,K)  on  the  value  for  descendents  of  the  optimal 

solution;  hence  these  points  must  each  be  subsequently  evaluated 

themselves  for  optimal  values.   The  second  alternative,  on  the 

other  hand,  fails  to  guarantee  that  the  value  F(W,L,K)  will  be 

determined  but  does  yield  an  optimal  value  for  all  descendents 

A'  for  which  ?a'.  <  K  and  yields  an  upper  bound  U(W(A').  1,(A'),K) 
-  1  1  —  _      _ 

for  all  other  descendents.   The  choice  between  these  alternatives 
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is  highly  dependent  on  the  probability  that  an  optimal  solution 
to  problem  ( 1 . a)  will  satisfy  constraint  (14)^  and  thus  may  change 
during  problem-solving. 

In  addition  a  number  of  other  changes  must  be  made  in  the 
algorithms.   Theorems  3  and  4  concerning  direct  determination  of 
optimal  solutions  must  be  revised  to  limit  solutions  to  those 
which  are  feasible  according  to  constraint  (14).   Theorems  6,7 
and  8  are  invalid  in  the  presence  of  (14),  thus  rendering  invalid 
equations  (2), (3)  and  (4).   Consequently  the  bounds  in  (4. a)  now 
become  simply  B(w.  , ,L)  and  U(w.   ,L) .   Similarly  the  dominance 

conditions  given  in  (6)  are  now  invalid  and  must  be  replaced  by 

24 
conditions  appropriate  to  the  constraints  on  the  problem. 

Theorem  10  concerning  the  generation  of  base  solutions  remains 

valid  together  with  Theorem  13.  However  both  Theorem  11  concerning 

s 
reduction  of  the  set  IP^  )  and  Theorem  12  concerning  the  use  of 

base  solutions  in  evaluation  require  extensive  revision  based  on 

the  feasibility  and  dominance  conditions  appropriate  to  the 

constraints  on  the  problem.   Finally,  the  procedures  of  both 

Section  HI  and  Section  IV  must  be  slightly  modified  to  handle 


24.   In  the  case  of  (14)  and/or  (16)  condition  (6)  is  replaced  by 
the  condition: 

1 .  ^  1 .  and  V .  >  V  .  . 
In  the  case  of  (15)  it  tollov!?s  from''"Theo^em  1  of  reference  |9l  that 
to  condition  (6)  should  be  added  the  following: 

<(L-lj)/l.>  +  e.  <  d.. 
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constraint  ( 14)  . 

Between  these  extremes  are  problems  which  can  be  solved 
with  small  or  moderate  changes  in  the  basic  algorithms.   We  conclude 
with  two  illustrations  in  which  a  knapsack  function  is  to  be 
evaluated  for  a  number  of  different  stock  sizes.   In  the  first 
example  the  knapsack  function  F(W,L),  0  <  W  <  W    ,  0<  L<  L     is  to  be 
evaluated  at  each  stage  k  for  each  of  the  stock  sizes  W  xL  , 


W  XL  ,  and  W  XL   shown  in  Figure  7. 


(I,,W^) 


w 


(^2'V 


Figure  7.   Multiple  stock  sizes. 

This  can  be  done  efficiently  by  evaluating  concomitantly  at  each 

stage  k  the  points  in  the  shaded  area  of  the  Figure.   To  accomplish 

this  the  basic  algorithms  are  modified  to  simply  make  L    dependent 

^  max 

at  all  times  on  the  width  w.  be  considered  when  cutting  lengthwise, 

and  W     at  all  times  dependent  on  1,  when  cutting  widthwise.   In 
max  K 

the  second  illustration  evaluation  of  the  knapsack  function  F(L) 

is  desired  for  (only)  lengths  L  ^L^^.-.^L^.   This  can  be  accomplished 

efficiently  by  modifying  the  basic  algorithm  employing  the  procedure 
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of  Section ni  to  always  select  the  largest  unevaluated  length 
from  the  set  [h^,h^, . . . ,h^] ,    evaluation  being  complete  when  the 
set  becomes  empty. 
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APPENDIX  A:   ONE-DIMENSIONAL  EX/^J^PLE 

Maximum  'knapsack  size  L    =13 

max 


1. 

1 


V. 

1 


<^, 


1 
2 
3 
4 


6 
3 
5 
2 


6 
2 

3 

1 


1 

2/3 
3/5 
1/2 


TABLE  A.l   POTENTIAL  KNAPSACK  SOLUTIONS  A  .  =  (a  , a^ , a^ , a^) 
LISTED  IN  LEXICOGRAPHICALLY  DECREASING  ORDER 


Index 

Solution 

Length 

Value 

Index 

Solution 

Length 

Value 

J 

^^2^2 
2  0  0 

1^4 
0 

I  . 
1 

V. 

1 

J 

^1 
0 

a, 

1 

i^2 

1 

^4 
2 

L  . 

1 

V. 

J 

1 

12 

12 

23 

12 

7 

2 

1 

2 

0 

0 

12 

10 

24 

0 

1 

1 

1 

10 

6 

3 

1 

1 

0 

2 

13 

10 

25 

0 

1 

1 

0 

8 

5 

4 

1 

1 

0 

1 

11 

9 

26 

0 

0 

5 

13 

7 

5 

1 

1 

0 

0 

9 

8 

27 

0 

1 

0 

4 

11 

6 

6 

1 

0 

1 

1 

13 

10 

28 

0 

1 

0 

3 

9 

5 

7 

1 

0 

1 

0 

11 

9 

29 

0 

1 

0 

2 

7 

4 

8 

1 

0 

0 

3 

12 

9 

30 

0 

1 

0 

1 

5 

3 

9 

1 

0 

0 

2 

10 

8 

31 

0 

1 

0 

0 

3 

2 

10 

1 

0 

0 

1 

8 

7 

32 

0 

0 

2 

1 

12 

7 

11 

1 

0 

0 

0 

6 

6 

33 

0 

0 

2 

0 

10 

6 

12 

0 

4 

0 

0 

12 

8 

34 

0 

0 

1 

4 

13 

7 

13 

0 

3 

0 

2 

13 

8 

35 

0 

0 

1 

3 

11 

6 

14 

0 

3 

0 

1 

11 

7 

36 

0 

0 

1 

2 

9 

5 

15 

0 

3 

0 

0 

9 

6 

37 

0 

0 

1 

1 

7 

4 

16 

0 

2 

1 

1 

13 

a 

38 

0 

0 

1 

0 

5  . 

3 

17 

0 

2 

1 

0 

11 

7 

39 

0 

0 

0 

6 

12 

6 

18 

0 

2 

0 

3 

12 

7 

40 

0 

0 

0 

5 

10 

5 

19 

0 

2 

0 

2 

10 

6 

41 

0 

0 

0 

4 

8 

4 

20 

0 

2 

0 

1 

8 

5 

42 

0 

0 

0 

3 

6 

3 

21 

0 

2 

0 

0 

6 

4 

43 

0 

0 

0 

2 

4 

2 

22 

0 

1 

2 

0 

13 

3 

44 

0 

0 

0 

1 

2 

1 
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TABLE  A. 2  POTENTIAL  KNAPSACK  SOLUTIONS 

LISTED  IN  DECREASING  ORDER  BY  LENGTH, 
LEXICOGRAPHICALLY  DECREASING  ORDER  WITHIN  LENGTH 


Index 

Length 

Value 

Index 

Length 

Value 

J 

L  . 

1 

V. 
J 

10 

J 

L  . 
1 

V. 

1 

3 

13 

19 

10 

6 

6 

13 

10 

24 

10 

6 

13 

13 

8 

33 

10 

6 

16 

13 

8 

40 

10 

6 

22 

13 

8 

5 

9 

8 

26 

13 

7 

15 

9 

6 

34 

13 

7 

28 

9 

5 

1 

12 

12 

36 

9 

5 

2 

12 

10 

10 

8 

7 

8 

12 

9 

20 

8 

5 

12 

12 

8 

25 

8 

5 

17 

12 

7 

41 

8 

4 

23 

12 

7 

29 

7 

4 

32 

12 

7 

37 

7 

4 

39 

12 

6 

11 

6 

6 

4 

11 

9 

21 

6 

4 

7 

11 

9 

42 

6 

3 

14 

11 

7 

30 

5 

3 

17 

11 

7 

38 

5 

3 

27 

11 

6 

43 

4 

2 

35 

11 

6 

31 

3 

2 

9 

10 

8 

44 

2 

1 
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TABLE  A. 3         MAXIMUM  KNAPSACK  VALUE  F(L) 

FOR  KNAPSACK  OF  LENGTH  L 

Index        Length  Value 
i_          L  F(L) 

1            13  12 

1            12  12 

4  11  9 
9           10  8 

5  9  8 

10  8  7 

11  7  6 
11            6  6 

30  5  3 

43  4  2 

31  3  2 

44  2  1 
1  0 


TABLE  A. 4      SCHEDULE  OF  NON-DOMINATED  OPTIMAL  SOLUTIONS 


Value 

Length 

Sol 

p  t  i  on 

Aj 

Index 

V 

L 

2 

^2 
0 

^3 

0 

^4 
0 

J 

12 

12 

1 

9 

11 

1 

1 

0 

1 

4 

8 

9 

1 

1 

0 

0 

5 

7 

8 

1 

0 

0 

1 

10 

6 

6 

1 

0 

0 

0 

11 

3 

5 

0 

1 

0 

1 

30 

2 

3 

0 

1 

0 

0 

31 

1 

2 

0 

0 

0 

1 

44 
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TABLE   A. 5  BASE    SOLUTIONS 


Index 

Base   So; 

Lution   P^ 

Length 

Value 

J 

a. 

L^ 

a   a 
2    3    4 

i 

^1 

0 

0 

0 

0 

0 

0 

0 

1 

3 

0 

0 

0 

18 

18 

2 

0 

2 

0 

0 

6 

4 

3 

0 

0 

1 

0 

5 

3 

4 

0 

0 

0 

1 

2 

1 

5 

2 

0 

0 

1 

14 

13 

6 

0 

2 

0 

1 

8 

5 

7 

0 

0 

1 

1 

7 

4 

8 

0 

0 

0 

2 

4 

2 

9 

2 

0 

0 

2 

14 

14 

10 

0 

1 

0 

2 

7 

4 

11 

0 

0 

1 

2 

9 

5 

12 

0 

0 

0 

3 

6 

3 

13 

2 

0 

1 

0 

17 

15 

14 

0 

1 

1 

0 

8 

5 

15 

0 

0 

2 

0 

10 

6 

16 

(0 

0 

0 

3) 

6 

3 
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APPENDIX   B:   TWO-DIMENSIONAL  EXAMPLE 

Maximum  knapsack  size  W=8,  L=13 


w. 


♦. 


1 
2 

3 
4 


6 
3 
5 
2 


3 
5 
6 
2 


6 
2 
3 
1 


1 

2/3 
3/5 
1/2 


TABLE  B.l   POTENTIAL  KNAPSACK  SOLUTIONS  A.=(a  ,a   a   a  ) 
LISTED  IN  LEXICOGRAPHICALLY  DECREASING  ORDER 


Index 

Solution 

width 

Length 

J 

^^2^3^4 
2  0  0  0 

W  . 
] 
3 

L  . 

1 

1 

12 

2 

1 

2 

0 

0 

5 

12 

3 

1 

1 

0 

2 

5 

13 

4 

1 

1 

0 

1 

5 

11 

5 

1 

1 

0 

0 

5 

9 

6 

1 

0 

1 

1 

6 

13 

7 

1 

0 

1 

0 

6 

11 

8 

1 

0 

0 

3 

3 

12 

9 

1 

0 

0 

2 

3 

10 

10 

1 

0 

0 

1 

3 

8 

11 

1 

0 

0 

0 

3 

6 

12 

0 

4 

0 

0 

5 

12 

13 

0 

3 

0 

2 

5 

13 

14 

0 

3 

0 

1 

5 

11 

15 

0 

3 

0 

0 

5 

9 

16 

0 

2 

1 

1 

6 

13 

17 

0 

2 

1 

0 

6 

11 

18 

0 

2 

0 

3 

5 

12 

19 

0 

2 

0 

2 

5 

10 

20 

0 

2 

0 

1 

5 

8 

21 

0 

2 

0 

0 

5 

6 

22 

0 

1 

2 

0 

6 

13 

Value 

V. 

1__ 


12 
10 
10 
9 
8 
10 
9 
9 
8 
7 
6 
8 
8 
7 
6 
8 
7 
7 
6 
5 
4 


Index 

Solution 

Width 

Length 

Value 

J 

0  ].  1 

i^4 
2 

W  . 

1 
6 

L  . 

1 

V. 

1 

23 

12 

7 

24 

0 

1 

1 

1 

6 

10 

6 

25 

0 

1 

1 

0 

6 

8 

5 

26 

0 

1 

0 

5 

5 

13 

7 

27 

0 

1 

0 

4 

5 

11 

6 

28 

0 

1 

0 

3 

5 

9 

5 

29 

0 

1 

0 

2 

5 

7 

4 

30 

0 

1 

0 

1 

5 

5 

3 

31 

0 

1 

0 

0 

5 

3 

2 

32 

0 

0 

2 

1 

6 

12 

7 

33 

0 

0 

2 

0 

6 

10 

6 

34 

0 

0 

1 

4 

6 

13 

7 

35 

0 

0 

1 

3 

6 

11 

6 

36 

0 

0 

1 

2 

6 

9 

5 

37 

0 

0 

1 

1 

6 

7 

4 

38 

0 

0 

1 

0 

6 

5 

3 

39 

0 

0 

0 

G 

2 

12 

6 

40 

0 

0 

0 

5 

2 

10 

5 

41 

0 

0 

0 

4 

2 

8 

4 

\2 

0 

0 

0 

3 

2 

6 

3 

43 

0 

0 

0 

2 

2 

4 

2 

44 

0 

0 

0 

1 

2 

2 

1 
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TABLE  *  B.2   VALUE  OF  KNAPSACK  FUNCTION  F(W,L) 


\l 

w\ 

1 

2 

3 

4 

5 

6 

7 

8 

9 

10 

11 

12 

13 

6 

1  1 
0 

4  3 

1 

2  2 
2 

7  3 
2 

4  3 
3 

2  2 
6 

6  3 
6 

4  3 
7 

2  2 

8 

5  3 
8 

4  3 
9 

2  2 
12 

3  3 
12 

5 

8  4 
0 

4  3 

1 

2  2 

® 

12  3 
2 

4  3 

® 

2  2 

6 

11  3 
6 

4  3 
7 

2  2 

® 

10  3 
8 

4  3 

® 

2  2 
12 

9  3 
12 

3 

X 

4  3 

1 

X 

14  3 
2 

X 

2  2 

® 

X 

4  3 

® 

X 

13  3 

® 

X 

2  2 

X 

2 

X 

4  3 

® 

X 

14  3 

X 

15  5 

®, 

X 

L5  5 
®, 

X 

15  5 

® 

X 

15  5 

® 

X 

*The  number  in  the  upper  left  corner  indicates  the  group  in 
which  the  cell  is  evaluated  with  the  algorithm  of  Figure  5 , 
the  number  in  upper  right  corner  with  the  modified  algorithm. 
The  circled  values  denote  the  nondominated  entries. 


TABLE  B.3    OPTIMAL  SOLUTIONS*  YIELDING  F(W,L) 


Y, 

1 

2 

3 

4 

5 

6 

7 

8 



9 

-_  -J 

11 

12 

13 

6 

- 

44 

31 

31 

30,38 

11 

11 

10 

5 

5 

4,7 

1 

1 

5 

- 

44 

31 

31 

30 

11 

11 

10 

5 

5 

4 

1 

1 

3 
2 

- 

44 

- 

43 

- 

11 

- 

10 

- 

t 
9  i   - 

1 

- 

- 

44 

- 

43 

- 

42 

" 

41 

40  i   - 

1 

39 

- 

*The  number  m  the  cell  identifies  the  solution  in 
Table  B.l. 
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TABLE  B.4     BA?^E  SOLUTIONS  FOR  TWO-DIMENSIONAL  EXAMPLE 


Index  Base  Solution  P_.   Width   Length   Value 


0 

0 

0 

0    0 

1 

3 

0 

0    0 

2 

0 

2 

0    0 

3 

0 

0 

]_    0 

4 

0 

0 

0    1 

5 

2 

0 

0    1 

6 

0 

2 

0    1 

7 

0 

0 

1  1 

8 

0 

0 

0    2 

9 

2 

0 

1    0 

10 

-      0 

1 

1    0 

11 

0 

0 

2    0 

12 

0 

0 

1    1 

13 

3 

0 

0    2 

14 

0 

1 

0    2 

15 

0 

0 

1    2 

15 

0 

0 

0    3 

a,  a^a^a  .       a  .      ^    .  f  . 

1  2  3  4  _  j._      1     _  i. 


0  0  0 

3  18  18 

5  6  4 

6  5  3 

2  2  1 

3  14  13 

5  8  5 

6  7  4 
2.4  2 
6  17  15 
6  8  5 
6  10  6 
6  7  4 
3  22  20 

5  7  4 

6  9  5 
2  6  3 
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APPENDIX  C:   STAGE  K-1  OF  TWO-DIMENTIONAL  EXAMPLE 


Item   Length    VJidth    Value      ^ 


1 

12 

2 

6 

3 

2 

12 

3 

12 

A 

3 

11 

5 

9 

9/5 

4 

10 

2 

5 

5/2 

5 

10 

3 

8 

8/3 

6 

9 

5 

8 

8/5 

7 

8 

2 

4 

2 

8 

8 

3 

7 

7/3 

9 

6 

2 

3 

3/2 

10 

6 

3 

6 

2 

11 

5 

5 

3 

3/5 

12 

4 

2 

2 

1 

13 

3 

5 

2 

2/5 

14 

2 

2 

1 

]/2 

-87- 
T.'BTE  C.l   POTENTIAL  KNAPSACK  SOLUTIONS*  A""(^i32^3^ 
FOR  STAGE  k-1. 


Index 

Solution 

width 

J 

a  a  a 
12  3 

4  0  0 

W  , 
J 

1 

8 

2 

3 

0 

0 

6 

3 

2 

1 

0 

7 

4 

2 

0 

0 

4 

5 

1 

2 

0 

8 

6 

1 

1 

0 

5 

7 

1 

0 

1 

7 

8 

1 

0 

0 

2 

9 

0 

2 

0 

6 

10 

0 

1 

1 

8 

11 

0 

1 

0 

3 

12 

0 

0 

1 

5 

*The  values  a,, a   and  a   denote  respectively  the  number  of  units 
in  the  solution  of  width  2,  3  and  5. 


TABLE  C.2   BASE  SOLUTIONS  FOR  STAGE  K-1 


[ndex 

Base  Solution  P_. 
^^2^3      ' 

Width 

J 

W^ 

0 

0  0  0 

0 

1 

2  0  0 

4 

2 

0  3  0 

9 

3 

3  0  0 

6 

4 

2  2  0 

10 

5 

0  0  1 

5 

6 

5  0  0 

10 
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TABLE  C.3     VALUE  OF  KNAPSACK  FUNCTION  F   ,{W,L) 


X 

1 

2 

3 

4 

5 

6 

7 

8 

13 

"  0 

2 

6 

2 

12 

3 

12 

2 

18 

2 

24 

3 

24 

2 

30 

12 

% 

2 

© 

2 

Q 

3 

12 

2 

Q 

2 

^ 

3 

24 

2 

^ 

11 
10 

^  0 

6 

5 

6 

8 

7 

10 

6 

13 

6 

16 

7 

18 

6 

21 

% 

6 

(5) 

6 

® 

7 

© 

6 

Q 

6 

(6) 

7 

Q 

6 

(^ 

9 

% 

10 

a-: 

10 

® 

11 

& 

10 

Q 

10 

0) 

11 

Q 

10 

Q 

8 

^^0 

10 

4 

10 

7 

11 

8 

10 

11 

10 

14 

11 

15 

10 

18 

7 

^^0 

14 

(5) 

1*  ® 

15 

6 

14 

Q 

14 

Q 

15 

12 

14 

Q 

6 

'''    0 

14 

3 

14 

6 

15 

^ 

14 

9 

14 

12 

15 

12 

14 

15 

S 

^'   0 

18 

2 

21 

2 

18 

4 

20 

4 

18 

.6 

19 

6 

18 

B 

4 

2^0 

18 

G) 

25 

2 

18 

(^ 

24 

4 

18 

Q 

23 

6 

18 

® 

3 

'% 

27 

1 

30 

1 

27 

- 

? 

27 

-> 

28 

3 

27 

4 

2 

^^0 

27 

f?) 

34 

1 

27 

(?) 

33 

2 

27 

Q 

32 

3 

27 

G) 

1 

^"^Q 

36 

0 

36 

0 

36 

0 

36 

0 

36 

0 

36 

0 

36 

0 
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TABLE  C.4   OPTIMAL  SOLUTIONS*   YIELDING  F,   ,(W,L) 

k-1   * 


X 

1 

2 

3 

4 

5 

6 

7 

8 

13 

_ 

8 

11 

4 

6 

9 

3 

5 

12 

- 

8 

11 

4 

6 

9 

3 

5 

11 

- 

8 

11 

4 

6 

9 

3 

5 

10 
9 

— 

8 

11 

4 

6 

9 

3 

5 

— 

8 

11 

4 

6 

9 

3 

5 

8 

- 

8 

11 

4 

6 

9 

3 

5 

7 

- 

8 

11 

4 

6 

9 

3 

5 

6 

- 

8 

11 

4 

6 

9 

3 

5 

5 

— 

8 

8 

4 

4 

2 

2 

1 

4 

— 

8 

8 

4 

4 

2 

2 

1 

3 

- 

8 

8 

4 

4 

2 

2 

1 

2 

- 

8 

8 

4 

4 

2 

2 

1 

1 

- 

- 

- 

- 

- 

- 

- 

*The  number  in  cell  identifies  solution  in  Table  C.l 
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